Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.

Re: [netcdf-java] GridCoordSys introduces rounding error when converting from km to m and integer axis-type

  • To: Heiko Klein <Heiko.Klein@xxxxxx>
  • Subject: Re: [netcdf-java] GridCoordSys introduces rounding error when converting from km to m and integer axis-type
  • From: John Caron <caron@xxxxxxxxxxxxxxxx>
  • Date: Tue, 25 Aug 2009 17:49:16 -0600
Heiko Klein wrote:
The class ucar.nc2.dt.grid.GridCoordSys converts internally all projection-axes to km. But it seems like it does not convert the datatype to a float or double datatype and introduces therefore large rounding errors.

I have given my axes as m (in integer):
-3716017, -3712004, -3707991

The isRegular function of Coordinate1D sees (with a debugger attched) the values:
-3716, -3712, -3707
and as such fails with my approx. 4km grid-distance.



Best regards,

Heiko


this will be fixed in the next release of 4.1, thanks for reporting!



  • 2009 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdf-java archives: