question about output from ncdump -p option

Hello All,

I don't understand the output I'm getting for a float variable when I use the -p option of the ncdump command. For example here is a file where I specified precision of the ncdump utility as -p 4,7:

// Chl_ctrl(6, 0-95)
  0.006179, 0.005789, 0.002502, 0.002943, 0.003311, 0.003856, 0.006481,
  0.01431, 0.02607, 0.06223, 0.08741, 0.08848, 0.09337, 0.08391, 0.06148,
  0.03593, 0.03441, 0.06112, 0.08778, 0.06033, 0.05429, 0.05096, 0.0419,
  0.01465, 0.01362, 0.005015, 0.004674, 0.0125, 0.0115, 0.01906, 0.00876,
0.01265, 0.01997, 0.04652, 0.1069, 0.207, 0.2227, 0.1509, 0.1123, 0.1001,
  0.1286, 0.1413, 0.366, 0.3504, 0.2979, 0.2345, 0.1877, 0.1553, 0.1623,
  0.2175, 0.2735, 0.3266, 0.3792, 0.4103, 0.3368, 0.2046, 0.0996, 0.04868,
  0.04047, 0.05427, 0.07043, 0.1198, 0.3692, 0.5651, 0.5157, 0.4695,
  0.4163, 0.3637, 0.3992, 0.3953, 0.3175, 0.2811, 0.2669, 0.2539, 0.1959,
  0.1751, 0.2147, 0.2245, 0.3235, 0.3358, 0.3153, 0.3176, 0.2354, 0.112,
  0.01587, 0.005737, 0.009106, 0.008648, 0.01087, 0.005333, 0.009314,
  0.008883, 0.02158, 0.01859, 0.0059, 0.003995,

Based on the documentation for the ncdump command's -p option I expected to see decimals places of 4 or less, yet I'm getting 6. Here is same variable with precision set at -p 2,2

// Chl_ctrl(6, 0-95)
  0.0062, 0.0058, 0.0025, 0.0029, 0.0033, 0.0039, 0.0065, 0.014, 0.026,
  0.062, 0.087, 0.088, 0.093, 0.084, 0.061, 0.036, 0.034, 0.061, 0.088,
  0.06, 0.054, 0.051, 0.042, 0.015, 0.014, 0.005, 0.0047, 0.012, 0.012,
  0.019, 0.0088, 0.013, 0.02, 0.047, 0.11, 0.21, 0.22, 0.15, 0.11, 0.1,
  0.13, 0.14, 0.37, 0.35, 0.3, 0.23, 0.19, 0.16, 0.16, 0.22, 0.27, 0.33,
  0.38, 0.41, 0.34, 0.2, 0.1, 0.049, 0.04, 0.054, 0.07, 0.12, 0.37, 0.57,
  0.52, 0.47, 0.42, 0.36, 0.4, 0.4, 0.32, 0.28, 0.27, 0.25, 0.2, 0.18,
  0.21, 0.22, 0.32, 0.34, 0.32, 0.32, 0.24, 0.11, 0.016, 0.0057, 0.0091,
  0.0086, 0.011, 0.0053, 0.0093, 0.0089, 0.022, 0.019, 0.0059, 0.004

I expected to see decimal values of no more than 2 places, yet I'm getting up to 4. Can anyone explain how to interpret what the ncdump utility is giving me? I should mention that I'm also using the -b c option in the same command.

Any comments would be most appreciated.

Janeen

==============================================================================
To unsubscribe netcdfgroup, visit:
http://www.unidata.ucar.edu/mailing-list-delete-form.html
==============================================================================


  • 2006 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: