Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.

Re: HDF5 chunking questions...

NOTE: The netcdf-hdf mailing list is no longer active. The list archives are made available for historical reasons.

Hi John,

> perhaps we should have 3 modes of chunking, that the user can choose:
> 
>     1) preseve the record oriented nature of our current unlimited 
> dimension to optimize sequential reading of the array.
    What does this mean?

>     2) choose an optimal chunk size (some small multiple of disk block 
> size: 8K, 16K, 32K?) and subdivide the dimensions evenly to optimize 
> over all types of subsetting.
    This is similar to the heuristic I suggested to Ed.

>     3) full user spec of chunk size and chunk dimension size.
    Always possible.

        Quincey

  • 2003 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdf-hdf archives: