[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[netCDF #HOT-122007]: converting grib2 files to netcdf using wgrib2 -netcdf



Im not sure what you mean by a "Grib2 file". Everything inside the CDM library 
uses the NetcdfFile abstraction.

> Dear Unidata:
> 
> Thanks for the help.  When I wrap the original dataset in ncml, can the
> original dataset be a Grib2 file or must it be NetCDF?
> 
> Thanks,
> 
> Larry Mastin
> 
> David A. Johnston Cascades Volcano Observatory
> 1300 SE Cardinal Court, Bldg. 10, Suite 100
> Vancouver, WA 98683 USA
> tel. 360-993-8925  fax 360-993-8980
> http://vulcan.wr.usgs.gov/Projects/Mastin
> -----Original Message-----
> From: Unidata netCDF Java Support
> [mailto:address@hidden]
> Sent: Friday, November 06, 2009 2:59 PM
> To: address@hidden
> Cc: address@hidden
> Subject: [netCDF #HOT-122007]: converting grib2 files to netcdf using wgrib2
> -netcdf
> 
> The -isLargeFile option is now in the lastest 4.1 release at:
> 
> http://www.unidata.ucar.edu/software/netcdf-java/
> 
> under the "Development version 4.1" downloads.
> 
> You can wrap the original dataset in ncml, and use the <remove> element to
> remove the ones you dont want, see
> 
> http://www.unidata.ucar.edu/software/netcdf/ncml/
> 
> example at:
> 
> http://www.unidata.ucar.edu/software/netcdf/ncml/v2.2/Cookbook.html#remove
> 
> the xml file must have the suffix ".ncml", and it then becomes the "in"
> file:
> 
> java -Xmx512m -classpath netcdfAll-4.0.jar ucar.nc2.dataset.NetcdfDataset
> -in myfile.ncml -out out.nc
> 
> > Russ:
> >
> > Thanks again for the quick response.  Actually, I only need the wind field
> > data (UGRD, VVEL, AND VGRD), and only for a particular geographic
> subregion.
> > If there's a way to just convert those data to NetCDF, the -isLargeFile
> > option won't be necessary.
> >
> > I'm just learning how to do this.  I'll poke through the NetCDF-Java
> > documentation.  If you know offhand how it would be done and can tell me,
> > that would be even better.
> >
> > Thanks again,
> >
> > Larry
> >
> > David A. Johnston Cascades Volcano Observatory
> > 1300 SE Cardinal Court, Bldg. 10, Suite 100
> > Vancouver, WA 98683 USA
> > tel. 360-993-8925  fax 360-993-8980
> > http://vulcan.wr.usgs.gov/Projects/Mastin
> > -----Original Message-----
> > From: Unidata netCDF Java Support
> > [mailto:address@hidden]
> > Sent: Thursday, November 05, 2009 4:41 PM
> > To: address@hidden
> > Cc: address@hidden
> > Subject: [netCDF #HOT-122007]: converting grib2 files to netcdf using
> wgrib2
> > -netcdf
> >
> > Hi Larry:
> >
> > The problem is that the 2 Gb netcdf file limit is being exceeded (yes it
> > expands that much!). I will add a -isLargeFile option to allow writing to
> > the 64-bit offset version. It will take a few days to get teh release out,
> > ill let you know when its ready.
> >
> > > Thanks, Russ.
> > >
> > > I downloaded NetCDFAll-4.0.jar from that site and it now finds the main
> > > class.  However I am getting another error message indicating the
> > > variable starting position is exceeding an allowed value (see below).
> > >
> > > My grib2 file is pretty big (383 Mb).  Is there a size limit to the
> > > grib2 files that can be read?
> > >
> > > Thanks,
> > >
> > > Larry
> > >
> > > *******************************************************************
> > > Command & error messages below:
> > >
> > > lgmastin@phobos:~/ncj> java -Xmx512m -classpath netcdfAll-4.0.jar
> > > ucar.nc2.dataset.NetcdfDataset -in
> > > ~/grib2/testfiles/NAM_Alaska_11km_20090920_0600.grib2 -out
> > > ~/grib2/testfiles/NAM_Alaska_11km_20090920_0600.nc
> > > Read
> > > from /home/lgmastin/grib2/testfiles/NAM_Alaska_11km_20090920_0600.grib2
> > > write to /home/lgmastin/grib2/testfiles/NAM_Alaska_11km_20090920_0600.nc
> > >
> > > Exception in thread "main" java.lang.IllegalArgumentException: Variable
> > > starting pos=2343709348 may not exceed 2147483647
> > > at ucar.nc2.iosp.netcdf3.N3header.writeHeader(N3header.java:626)
> > > at ucar.nc2.iosp.netcdf3.N3header.create(N3header.java:560)
> > > at ucar.nc2.iosp.netcdf3.N3iosp.create(N3iosp.java:640)
> > > at ucar.nc2.NetcdfFileWriteable.create(NetcdfFileWriteable.java:594)
> > > at ucar.nc2.FileWriter.writeToFile(FileWriter.java:195)
> > > at ucar.nc2.dataset.NetcdfDataset.main(NetcdfDataset.java:1600)
> > >
> > >
> > > On Thu, 2009-11-05 at 16:11 -0700, Unidata netCDF Java Support wrote:
> > > > Larry,
> > > >
> > > > Alternatively, if from
> http://www.unidata.ucar.edu/software/netcdf-java/
> > > > you had downloaded
> > > >
> > > >   "The complete netCDF library (MD5) implements the full CDM model,
> with
> > all dependent jars included."
> > > >
> > > > you would have gotten  netcdfAll-4.0.jar file instead of the .zip file
> > you used, and that would have worked, using:
> > > >
> > > >   java -Xmx512m -classpath netcdfAll-4.0.jar
> > ucar.nc2.dataset.NetcdfDataset -in
> > ~/grib2/testfiles/NAM_Alaska_11km_20090920_0600.grib2 -out
> > > > ~/grib2/testfiles/NAM_Alaska_11km_20090920_0600.nc
> > > >
> > > > --Russ
> > > >
> > > >
> > > > Russ Rew                                         UCAR Unidata Program
> > > > address@hidden                     http://www.unidata.ucar.edu
> > > >
> > > >
> > > >
> > > > Ticket Details
> > > > ===================
> > > > Ticket ID: HOT-122007
> > > > Department: Support netCDF Java
> > > > Priority: Normal
> > > > Status: Closed
> > > >
> > >
> > >
> >
> >
> > Ticket Details
> > ===================
> > Ticket ID: HOT-122007
> > Department: Support netCDF Java
> > Priority: Normal
> > Status: Open
> >
> >
> >
> >
> 
> 
> Ticket Details
> ===================
> Ticket ID: HOT-122007
> Department: Support netCDF Java
> Priority: Normal
> Status: Closed
> 
> 
> 
> 


Ticket Details
===================
Ticket ID: HOT-122007
Department: Support netCDF Java
Priority: Normal
Status: Closed