Unidata - To provide the data services, tools, and cyberinfrastructure leadership that advance Earth system science, enhance educational opportunities, and broaden participation. Unidata
         
  advanced  
 

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #CGO-734297]: Directory Data load error



Hi Jason-

Sorry for the delay in responding.  We were out last week.

This is a bug that we are working on a fix for.  Thanks for finding it.  The
basic problem is that there is a space in the directory path (Documents and Settings)
which the URI parser doesn't like.  The quick solution would be to put
the files in a directory that doesn't have a space in it's path 
(e.g. c:\data\nam12km).

I'll let you know when we have a fix for this.

Don Murray

> I was trying to load a full run of 12km nam grib2 files from the ncep ftp. They were in the format:
> nam.t00z.awip21800.24.grib2
> nam.t00z.awip21803.24.grib2
> nam.t00z.awip21806.24.grib2
> etc..
> 
> I was using aggregated grib for the data type from the directory chooser.  When I used the verify button. The files showed up according to my mask which was "nam".  They were stored locally on my hd and the directory did not have any files changing or being added or removed.  When I loaded them from the files chooser, each file loaded fine individually but when I selected multiple files from open dialog, it returned the same error as loading the directory.  The settings I used were:
> 
> Data Source Type: Aggregated Grib Files
> Directory: C:\Documents and Settings\IceDown\My Documents\nam12km
> Name: Nam12km
> File Pattern: nam
> Include Hidden Files: False
> Files: All Files
> Polling: Off
> 
> Here is a dir from the directory;
> 
> C:\Documents and Settings\IceDown\My Documents\nam12km>dir
> Volume in drive C has no label.
> Volume Serial Number is 68E1-42C6
> 
> Directory of C:\Documents and Settings\IceDown\My Documents\nam12k
> 
> 06/06/2008  12:38 AM    <DIR>          .
> 06/06/2008  12:38 AM    <DIR>          ..
> 06/06/2008  12:35 AM           704,833 nam.t00z.awip21800.24.grib2
> 06/06/2008  12:35 AM           714,343 nam.t00z.awip21803.24.grib2
> 06/06/2008  12:35 AM           734,774 nam.t00z.awip21806.24.grib2
> 06/06/2008  12:35 AM           782,025 nam.t00z.awip21809.24.grib2
> 06/06/2008  12:35 AM           795,738 nam.t00z.awip21812.24.grib2
> 06/06/2008  12:35 AM           833,403 nam.t00z.awip21815.24.grib2
> 06/06/2008  12:35 AM           847,629 nam.t00z.awip21818.24.grib2
> 06/06/2008  12:35 AM           852,618 nam.t00z.awip21821.24.grib2
> 06/06/2008  12:35 AM           823,275 nam.t00z.awip21824.24.grib2
> 06/06/2008  12:35 AM           794,228 nam.t00z.awip21827.24.grib2
> 06/06/2008  12:35 AM           774,695 nam.t00z.awip21830.24.grib2
> 06/06/2008  12:35 AM           785,296 nam.t00z.awip21833.24.grib2
> 06/06/2008  12:35 AM           777,855 nam.t00z.awip21836.24.grib2
> 06/06/2008  12:35 AM           733,715 nam.t00z.awip21839.24.grib2
> 06/06/2008  12:35 AM           758,295 nam.t00z.awip21842.24.grib2
> 06/06/2008  12:35 AM           740,219 nam.t00z.awip21845.24.grib2
> 06/06/2008  12:35 AM           700,377 nam.t00z.awip21848.24.grib2
> 06/06/2008  12:35 AM           690,566 nam.t00z.awip21851.24.grib2
> 06/06/2008  12:35 AM           696,776 nam.t00z.awip21854.24.grib2
> 06/06/2008  12:35 AM           698,545 nam.t00z.awip21857.24.grib2
> 06/06/2008  12:35 AM           698,443 nam.t00z.awip21860.24.grib2
> 06/06/2008  12:35 AM           713,499 nam.t00z.awip21863.24.grib2
> 06/06/2008  12:35 AM           759,078 nam.t00z.awip21866.24.grib2
> 06/06/2008  12:35 AM           770,578 nam.t00z.awip21869.24.grib2
> 06/06/2008  12:35 AM           762,907 nam.t00z.awip21872.24.grib2
> 06/06/2008  12:35 AM           751,244 nam.t00z.awip21875.24.grib2
> 06/06/2008  12:35 AM           750,690 nam.t00z.awip21878.24.grib2
> 06/06/2008  12:35 AM           739,236 nam.t00z.awip21881.24.grib2
> 06/06/2008  12:35 AM           739,981 nam.t00z.awip21884.24.grib2
> 29 File(s)     21,924,861 bytes
> 2 Dir(s)     964,378,624 bytes free
> 
> 
> 
> If you need anymore information please contact me.  I still have everything the same and can still duplicate the problem.
> 
> 
> -----Original Message-----
> From: Unidata IDV Support [mailto:support-idv@xxxxxxxxxxxxxxxx]
> Sent: Friday, June 06, 2008 9:38 AM
> To: icedown@xxxxxxxxx
> Subject: [IDV #CGO-734297]: Directory Data load error
> 
> Hi Jason-
> 
> > Full Name: Jason Brooks
> > Email Address: icedown@xxxxxxxxx
> > Organization: StormGuard Solutions
> > Package Version: 2.5 build date:2008-05-08 07:05 UTC
> > Operating System: Windows XP
> > Hardware: Java: home: C:\Program Files\IDV_2.5\jre version: 1.5.0_11 j3d:1.3.2 fcs (build12)
> > Description of problem: There was an error loading the data:
> > java.lang.IllegalArgumentException
> >
> > Full trace includes this:
> >
> > Caused by: java.net.URISyntaxException: Illegal character in opaque part at index 23: file:file:/C:/Documents and Settings/IceDown/My Documents/nam12km/nam.t00z.awip21800.24.grib2
> >
> > I think the error is here:
> > file:file:/C:/
> >
> > Shouldn't it be
> > file:file://C:/
> >
> > This same error shows up when loading mulple files rom the files data source.  One file works fine though.
> 
> A few questions:
> 
> - what are you trying to do here?  Is it that you have several files,
> each with a different forecast time and you want to create an cohesive
> data set?
> - are you setting the Data Soure Type to Aggregated GRIB files?
> - when using the Directory chooser, is the data changing in that directory?
> 
> Thanks.
> 
> Don Murray
> > ******************
> > Stack trace:
> > java.lang.IllegalArgumentException
> > at java.net.URI.create(URI.java:842)
> > at ucar.nc2.util.NetworkUtils.resolve(NetworkUtils.java:66)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:283)
> > at ucar.nc2.ncml.NcMLReader.access$100(NcMLReader.java:48)
> > at ucar.nc2.ncml.NcMLReader$NcmlElementReader.open(NcMLReader.java:1095)
> > at ucar.nc2.NetcdfFileCache.acquire(NetcdfFileCache.java:188)
> > at ucar.nc2.ncml.Aggregation$Dataset._acquireFile(Aggregation.java:1185)
> > at ucar.nc2.ncml.Aggregation$Dataset.acquireFile(Aggregation.java:1171)
> > at ucar.nc2.ncml.Aggregation$Dataset.getNcoords(Aggregation.java:1099)
> > at ucar.nc2.ncml.Aggregation$Dataset.setStartEnd(Aggregation.java:1120)
> > at ucar.nc2.ncml.Aggregation$Dataset.access$100(Aggregation.java:1001)
> > at ucar.nc2.ncml.Aggregation.buildCoords(Aggregation.java:315)
> > at ucar.nc2.ncml.AggregationExisting.buildDataset(AggregationExisting.java:61)
> > at ucar.nc2.ncml.Aggregation.finish(Aggregation.java:293)
> > at ucar.nc2.ncml.NcMLReader.readNetcdf(NcMLReader.java:397)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:339)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:191)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:143)
> > at ucar.nc2.dataset.NetcdfDataset.openFile(NetcdfDataset.java:328)
> > at ucar.nc2.dataset.NetcdfDataset.openDataset(NetcdfDataset.java:175)
> > at ucar.nc2.dataset.NetcdfDatasetCache.acquire(NetcdfDatasetCache.java:203)
> > at ucar.nc2.dataset.NetcdfDatasetCache.acquire(NetcdfDatasetCache.java:183)
> > at ucar.nc2.dataset.NetcdfDatasetCache.acquire(NetcdfDatasetCache.java:171)
> > at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:72)
> > at ucar.unidata.data.grid.GeoGridDataSource.doMakeDataSet(GeoGridDataSource.java:961)
> > at ucar.unidata.data.grid.GeoGridDataSource.getDataset(GeoGridDataSource.java:982)
> > at ucar.unidata.data.grid.GeoGridDataSource.doMakeDataChoices(GeoGridDataSource.java:1009)
> > at ucar.unidata.data.DataSourceImpl.getDataChoices(DataSourceImpl.java:1681)
> > at ucar.unidata.data.FilesDataSource.sourcesChanged(FilesDataSource.java:403)
> > at ucar.unidata.data.grid.GeoGridDataSource.sourcesChanged(GeoGridDataSource.java:521)
> > at ucar.unidata.data.FilesDataSource.initWithPollingInfo(FilesDataSource.java:358)
> > at ucar.unidata.data.FilesDataSource.initAfterCreation(FilesDataSource.java:269)
> > at ucar.unidata.data.grid.GeoGridDataSource.initAfterCreation(GeoGridDataSource.java:434)
> > at ucar.unidata.data.DataManager.createDataSource(DataManager.java:1339)
> > at ucar.unidata.idv.IntegratedDataViewer.createDataSource(IntegratedDataViewer.java:1847)
> > at ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1766)
> > at ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1700)
> > at ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1681)
> > at ucar.unidata.idv.chooser.IdvChooser.makeDataSource(IdvChooser.java:839)
> > at ucar.unidata.idv.chooser.PollingFileChooser.doLoadInThread(PollingFileChooser.java:194)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:585)
> > at ucar.unidata.util.Misc$2.run(Misc.java:990)
> > at ucar.unidata.util.Misc$3.run(Misc.java:1018)
> > Caused by: java.net.URISyntaxException: Illegal character in opaque part at index 23: file:file:/C:/Documents and Settings/IceDown/My Documents/nam12km/nam.t00z.awip21800.24.grib2
> > at java.net.URI$Parser.fail(URI.java:2816)
> > at java.net.URI$Parser.checkChars(URI.java:2989)
> > at java.net.URI$Parser.parse(URI.java:3026)
> > at java.net.URI.<init>(URI.java:578)
> > at java.net.URI.create(URI.java:840)
> > ... 45 more
> >
> >
> >
> 
> 
> Ticket Details
> ===================
> Ticket ID: CGO-734297
> Department: Support IDV
> Priority: Normal
> Status: Open
> 
> 


Ticket Details
===================
Ticket ID: CGO-734297
Department: Support IDV
Priority: Normal
Status: Open


 
 
  Contact Us     Site Map     Search     Terms and Conditions     Privacy Policy     Participation Policy
 
National Science Foundation (NSF) UCAR Office of Programs University Corporation for Atmospheric Research (UCAR)   Unidata is a member of the UCAR Office of Programs, is managed by the University Corporation for Atmospheric Research, and is sponsored by the National Science Foundation.
P.O. Box 3000     Boulder, CO 80307-3000 USA     Tel: 303-497-8643     Fax: 303-497-8690