[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #RJZ-602723]: error with grib file on RAMADDA

> Any progress with this?
> I might like to show data availability and results at a meeting next week if 
> I could.
> 
> Actually I would like to time aggregate these files if there were an easy way 
> to reprocess them.
> 
> 
> Thanks,
> Brian
> 
> 

Brian,
      Some progress, you can now load those NCEP data into the IDV. But the 
ECMWF dataset are still not accessible.
      There are some changes in the TDM after the security break in to make the 
thredds server more secure. The TDM is back to running this morning, but I 
don't know how to let the RAMADDA server to link to the TDM. What the TDM doing 
is to generate the index files for all grib files, with the index files 
existed, the ramadda server can operate on these files. Otherwise, you will get 
those error. Since the ECMWF files are not related to the THREDDS data server, 
the TDM can not do anything on them at this moment to generate those index 
files.

       I am CC this to Jeff to see if you know how to link the TDM to RAMADDA. 


Yuan

> On Mar 3, 2014, at 5:35 PM, Unidata IDV Support <address@hidden> wrote:
> 
> >>> Are you thinking that I have this in a THREDDS catalog? No, in RAMADDA.
> >>>
> >>> I don't know where in the server-side files dialog in the RAMADDA entry 
> >>> to put data type.
> >>> I tried adding these in "Edit Properties"  as shown here:
> >>>
> >>> [cid:d56d0e17-54f1-4cdd-951d-22c30f325b84@amazon.rsmas.miami.edu]
> >>>
> >>>
> >>> But no luck.
> >>>
> >>
> >> Brian,
> >> I also compared with the ramadda server on the motherlode. There is one 
> >> small difference in the dataset opendap link:
> >>
> >> Yours:
> >> <access serviceName="opendap" 
> >> urlPath="http://weather.rsmas.miami.edu/repository/opendap/synth:601aa404-ac59-4abb-8c4f-11c08474a214:LzIwMTEtMTAvQW5hLTEwMDEwMDAwMTAwMTAwMDAxLmdyYg==/entry.das"/>
> >>
> >> and Motherlode ramadda:
> >> <access serviceName="opendap" 
> >> urlPath="http://motherlode.ucar.edu/repository/entry/show/output:data.opendap/entryid:synth:a136862d-1253-4096-b864-ac53028253d7:L3J0bW9kZWwvMTQwMzAzMDZfbm1tLkdyYkYwMzAwMA==/14030306_nmm.GrbF03000/dodsC/entry.das"/>
> >>
> >> I have the feeling that dodsC is the key to let the IDV know this is 
> >> gridded dataset, somehow is missing in your link. I am CC this to Jeff to 
> >> see if this is right and how to add this.
> >>
> >>
> >> Yuan
> >
> > Brian,
> >   Your ramadda server is not running correctly, I remember it was working 
> > last week if I specified the data source type. Did you change anything on 
> > the server?
> >
> >
> > Yuan
> >>>
> >>>
> >>> On Feb 28, 2014, at 3:11 PM, Unidata IDV Support wrote:
> >>>
> >>>>> So maybe this makes it a "support-ramadda" question, not an IDV 
> >>>>> question .
> >>>>>
> >>>> It is a ramadda question. But, not much difference where this question 
> >>>> being answered.
> >>>>
> >>>> I compared the grb1 dataset from NAM
> >>>>
> >>>> http://thredds.ucar.edu/thredds/catalog/grib/NCEP/NAM/CONUS_80km/catalog.xml
> >>>>
> >>>> to your catalog, and hope adding the data type can help. Could you give 
> >>>> it a try?
> >>>>
> >>>>
> >>>> Yuan
> >>>>
> >>>>>
> >>>>>> Just changing the .grb1 to .grb did not make the RAMADDA serve the 
> >>>>>> file out properly.
> >>>>>>
> >>>>>>
> >>>>>> But changing the filename on local (downloaded from RAMADDA) files
> >>>>>> made "I feel lucky" work OK on those.
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>> Brian,
> >>>>>>> If you specify the data type and format for these dataset in your 
> >>>>>>> catalog, you should be able to use the "I feel lucky".
> >>>>>>>
> >>>>>>> <dataType>GRID</dataType>
> >>>>>>> <dataFormat>GRIB-1</dataFormat>
> >>>>>>>
> >>>>>>>
> >>>>>>> Yuan
> >>>>>>>> ----------- error message:
> >>>>>>>> There was an error loading the data:
> >>>>>>>> Error creating data source:dods.grid with: 
> >>>>>>>> http://weather.rsmas.miami.edu/repository/opendap/synth:601aa404-ac59-4abb-8c4f-11c08474a214:L0QxRDAxMDIwMDAwMDEwMjAwMDAxLmdyYjE=/entry.das
> >>>>>>>> Grid data source failed making data set: 
> >>>>>>>> dods://weather.rsmas.miami.edu/repository/opendap/synth:601aa404-ac59-4abb-8c4f-11c08474a214:L0QxRDAxMDIwMDAwMDEwMjAwMDAxLmdyYjE=/entry.das
> >>>>>>>> Method failed:HTTP/1.1 500 Internal Server Error on URL= 
> >>>>>>>> http://weather.rsmas.miami.edu/repository/opendap/synth:601aa404-ac59-4abb-8c4f-11c08474a214:L0QxRDAxMDIwMDAwMDEwMjAwMDAxLmdyYjE=/entry.das.dds
> >>>>>>>>
> >>>>>>>> ******************
> >>>>>>>> Stack trace:
> >>>>>>>> opendap.dap.DAP2Exception: Method failed:HTTP/1.1 500 Internal 
> >>>>>>>> Server Error on URL= 
> >>>>>>>> http://weather.rsmas.miami.edu/repository/opendap/synth:601aa404-ac59-4abb-8c4f-11c08474a214:L0QxRDAxMDIwMDAwMDEwMjAwMDAxLmdyYjE=/entry.das.dds
> >>>>>>>> at opendap.dap.DConnect2.openConnection(DConnect2.java:271)
> >>>>>>>> at opendap.dap.DConnect2.getDDS(DConnect2.java:563)
> >>>>>>>> at opendap.dap.DConnect2.getDDS(DConnect2.java:537)
> >>>>>>>> at ucar.nc2.dods.DODSNetcdfFile.<init>(DODSNetcdfFile.java:240)
> >>>>>>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native 
> >>>>>>>> Method)
> >>>>>>>> at 
> >>>>>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> >>>>>>>> at 
> >>>>>>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> >>>>>>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> >>>>>>>> at 
> >>>>>>>> ucar.nc2.dataset.NetcdfDataset.openDodsByReflection(NetcdfDataset.java:1031)
> >>>>>>>> at ucar.nc2.dataset.NetcdfDataset.acquireDODS(NetcdfDataset.java:980)
> >>>>>>>> at 
> >>>>>>>> ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:664)
> >>>>>>>> at ucar.nc2.dataset.NetcdfDataset.openDataset(NetcdfDataset.java:421)
> >>>>>>>> at 
> >>>>>>>> ucar.nc2.dataset.NetcdfDataset.acquireDataset(NetcdfDataset.java:516)
> >>>>>>>> at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:117)
> >>>>>>>> at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:103)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.data.grid.GeoGridDataSource.doMakeDataSet(GeoGridDataSource.java:1156)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.data.grid.GeoGridDataSource.getDataset(GeoGridDataSource.java:1178)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.data.grid.GeoGridDataSource.initAfterCreation(GeoGridDataSource.java:502)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.data.DataManager.createDataSource(DataManager.java:1602)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.IntegratedDataViewer.createDataSource(IntegratedDataViewer.java:1980)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1897)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1831)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1804)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.chooser.IdvChooser.makeDataSource(IdvChooser.java:943)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.chooser.XmlChooser.makeDataSource(XmlChooser.java:280)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.chooser.ThreddsHandler.processNodes(ThreddsHandler.java:852)
> >>>>>>>> at 
> >>>>>>>> ucar.unidata.idv.chooser.ThreddsHandler.processNode(ThreddsHandler.java:781)
> >>>>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >>>>>>>> at 
> >>>>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >>>>>>>> at 
> >>>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >>>>>>>> at java.lang.reflect.Method.invoke(Method.java:597)
> >>>>>>>> at ucar.unidata.util.Misc$2.run(Misc.java:1217)
> >>>>>>>> at ucar.unidata.util.Misc$3.run(Misc.java:1243)
> >>>>>>>>
> >>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>> Ticket Details
> >>>>>>> ===================
> >>>>>>> Ticket ID: RJZ-602723
> >>>>>>> Department: Support IDV
> >>>>>>> Priority: Normal
> >>>>>>> Status: Open
> >>>>>>>
> >>>>>>
> >>>>>> Brian Mapes
> >>>>>> address@hidden or address@hidden
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>> Brian Mapes
> >>>>> address@hidden or address@hidden
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>> Ticket Details
> >>>> ===================
> >>>> Ticket ID: RJZ-602723
> >>>> Department: Support IDV
> >>>> Priority: Normal
> >>>> Status: Open
> >>>>
> >>>
> >>> Brian Mapes
> >>> address@hidden or address@hidden
> >>>
> >>>
> >>>
> >>>
> >>>
> >>
> >
> >
> > Ticket Details
> > ===================
> > Ticket ID: RJZ-602723
> > Department: Support IDV
> > Priority: Normal
> > Status: Open
> >
> 
> Brian Mapes
> address@hidden
> 
> 
> 
> 


Ticket Details
===================
Ticket ID: RJZ-602723
Department: Support IDV
Priority: Normal
Status: Open