Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.

Bzip2 compression redux

I forget to compare with gzip. I used gzip with -best, I didn't time but both bzip2 and gzip took a long time. Some of the other comparisons have been with GRIB or other files that have very different formats. Our files are very standard 3-dimensional (lat-lon-time) NetCDF files, with time as the record variable. The results: 

raw.nc        380,551,616

raw.nc.Z      143,716,211

raw.nc.gz     103,491,706

raw.nc.bz2     55,633,062


-Roy M.
--
Roy Mendelssohn
Pacific Fisheries Environmental Group
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: rmendels@xxxxxxxxxxxxx
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/
*** NOTE NEW AREA CODE ************

"Old age and treachery will overcome youth and skill."
  • 2000 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: