Re: [Gnu-arch-users] Free space wasting when handling binary files

[Andrew Suffield]

On Thu, Mar 24, 2005 at 06:15:59PM -0600, John Arbash Meinel wrote:
> It does depend on the size of the file versus the size of the
> compression window:
> 
> $ dd if=/dev/random of=file1 bs=1k count=10
> 10+0 records in
> 10+0 records out
> $ cp file1 file2
> $ tar czf files.tar.gz file1 file2
> $ ls -l file1 file2 files.tar.gz
> -rw-r--r--    1 jameinel jameinel    10240 Mar 24 18:07 file1
> -rw-r--r--    1 jameinel jameinel    10240 Mar 24 18:07 file2
> -rw-r--r--    1 jameinel jameinel    10586 Mar 24 18:07 files.tar.gz
> 
> $ dd if=/dev/random of=file1 bs=1k count=100
> 100+0 records in
> 100+0 records out
> $ cp file1 file2
> $ tar czf files.tar.gz file1 file2
> $ ls -l file1 file2 files.tar.gz
> -rw-r--r--    1 jameinel jameinel   102400 Mar 24 18:09 file1
> -rw-r--r--    1 jameinel jameinel   102400 Mar 24 18:09 file2
> -rw-r--r--    1 jameinel jameinel   205198 Mar 24 18:09 files.tar.gz
> 
> I don't know what the gzip window is, but the bzip2 window is 900k. (If
> we used bzip2 instead of gzip, the above holds true up until > 500k files).

gzip is DEFLATE, which limits everything to 64k because it was
targetted at systems with 16-bit integers.

-- 
  .''`.  ** Debian GNU/Linux ** | Andrew Suffield
 : :' :  http://www.debian.org/ |
 `. `'                          |
   `-             -><-          |

signature.asc
Description: Digital signature