Re: [netcdfgroup] ZFP compression for NetCDF4

See also the CCR project, where we hope to add new compression filters for
all netCDF users: https://github.com/ccr/ccr

On Tue, Mar 23, 2021 at 11:04 AM Dennis Heimbigner <dmh@xxxxxxxx> wrote:

> If you have the HDF5 ZFP plugin available, then you can certainly
> use it in netcdf.
> Some documentation on netcdf filter support is here:
>  >https://github.com/Unidata/netcdf/blob/master/NUG/filters.md
>
> =Dennis Heimbigner
>    Unidata
>
>
> On 3/23/2021 10:52 AM, Leigh Orf wrote:
> > Hello,
> >
> > I'm a long time user of HDF and netcdf. I create lots of data in my
> > research (severe weather simulation) and ZFP compression in HDF5 files
> > has been great. I'd like to be able to create netcdf4 files
> > (preferably using the netcdf API) with 3D fields compressed using the
> > lossy ZFP compression algorithm. I know that netcdf4 is HDF5 so it's
> > certainly possible.
> >
> > I'm wondering whether anyone could provide any pointers. I see 3
> > options really.
> >
> > 1. Create ZFP compressed netcdf4 files using the normal netCDF-C API
> > (my code is mostly C)
> > 2. Create ZFP compressed netcdf4 files using the HDF5 API (including
> > all the HDF5 special sauce that makes netcdf4 netcdf4)
> > 3. Use a version of nccopy that understands ZFP
> >
> > Are any of these options possible right now? If not where are we on
> > efforts to include ZFP into netCDF? I did grab the latest code on
> > github and saw references to ZFP but no filter code.
> >
> > Leigh Orf
> > UW-Madison
> >
> > _______________________________________________
> > NOTE: All exchanges posted to Unidata maintained email lists are
> > recorded in the Unidata inquiry tracking system and made publicly
> > available through the web.  Users who post to any of the lists we
> > maintain are reminded to remove any personal information that they
> > do not want to be made public.
> >
> >
> > netcdfgroup mailing list
> > netcdfgroup@xxxxxxxxxxxxxxxx
> > For list information or to unsubscribe,  visit:
> https://www.unidata.ucar.edu/mailing_lists/
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web.  Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> netcdfgroup mailing list
> netcdfgroup@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> https://www.unidata.ucar.edu/mailing_lists/
>
  • 2021 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: