Re: HDF5 chunking questions...

NOTE: The netcdf-hdf mailing list is no longer active. The list archives are made available for historical reasons.

Hi John,

> perhaps we should have 3 modes of chunking, that the user can choose:
>     1) preseve the record oriented nature of our current unlimited 
> dimension to optimize sequential reading of the array.
    What does this mean?

>     2) choose an optimal chunk size (some small multiple of disk block 
> size: 8K, 16K, 32K?) and subdivide the dimensions evenly to optimize 
> over all types of subsetting.
    This is similar to the heuristic I suggested to Ed.

>     3) full user spec of chunk size and chunk dimension size.
    Always possible.


  • 2003 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdf-hdf archives: