[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: TDS Fmrc aggregation problem



Hi Steven:

You have to use the <datasetFmrc> element, but then there is a bug in the 
MetdaaDataextraot. Its been fixed in the latest release 3.14.rc5. try it and let me 
know if it works. Thanks!

Steven.Anthony wrote:
Hey,
I installed the TDS version 3.14.rc2 and I'm having trouble getting these FMRC datasets to work.
Ive started off with a simple set of gfs_3 data (one day, in grib1 format) in hopes of minimizing complications.




from catalog.xml:

<dataset name="gfs3 test" ID="gfs3/test" urlPath="gfs3/test" dataType="Grid" serviceName="dods-http">
<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<aggregation dimName="run" type="forecastModelRunSingleCollection" timeUnitsChange="true" >
<scanFmrc location="/nomads3_data/raid2/noaaport/merged/gfs-hi/200611/20061129"
regExp=".*\.grb$"
runDateMatcher="#gfs_3_#yyyyMMdd_HH"
forecastOffsetMatcher="HHH#.grb#"/>
</aggregation>
</netcdf>
</dataset>


This works in that I can get to the opendap browser, however, when I try to ascii dump a variable that uses the "run" dimension, I get an error:

Error {
    code = 0;
    message = "Connection cannot be read 
http://nomads-d.ncdc.noaa.gov:8081/thredds/dodsC/gfs3/test.dods?latLonCoordSys,Temperature[0:1:3][0:1:60][0:1:25][0:1:180][0:1:359]
 The descriptor object returned from the dataset was null
Check that the URL is correct.";
};


However, if I encapsulate the NCML in <datasetFmrc> tags instead, it fails to generate html output. When I check the log file (threddsServlet.log) it ends with a exception.

2006-11-30T09:53:06.240 -0500 [    783735][      26] INFO  - thredds.servlet.ServletUtil 
- Remote host: 192.153.129.158 - Request: "GET 
/thredds/catalog/gfs3/testFmrc/catalog.html HTTP/1.1"
2006-11-30T09:53:06.252 -0500 [    783747][      26] ERROR - 
thredds.catalog.InvDatasetFmrc - Error making catalog for gfs3/testFmrc
java.lang.NullPointerException
        at 
ucar.nc2.thredds.MetadataExtractor.extractVariables(MetadataExtractor.java:181)
        at thredds.catalog.InvDatasetFmrc.makeCatalog(InvDatasetFmrc.java:273)
        at thredds.catalog.InvDatasetFmrc.makeCatalog(InvDatasetFmrc.java:141)
        at 
thredds.servlet.DataRootHandler.makeDynamicCatalog(DataRootHandler.java:1107)
        at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1075)
        at 
thredds.servlet.DataRootHandler.processReqForCatalog(DataRootHandler.java:991)
        at thredds.servlet.CatalogServlet.doGet(CatalogServlet.java:78)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
        at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
        at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
        at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
        at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
        at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:432)
        at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
        at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
        at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
        at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
        at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
        at 
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
        at 
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
        at 
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
        at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
        at java.lang.Thread.run(Thread.java:595)
2006-11-30T09:53:06.267 -0500 [    783762][      26] INFO  - 
thredds.servlet.ServletUtil - Request Completed - 404 - 0 - 27

It looks as if there is a problem reading the variables (I think the same way that the opendap server fails to read variables with the new dimension.)
Let me know If I can provide any more information.


Thanks,
 - Steven Anthony




-- Steven Anthony Computer Systems Analyst NOMADS Project STG Inc. Federal Contractor Veach-Baley Federal Building 151 Patton Avenue Asheville, NC 28801-5001 Phone: 828.271.4474

http://nomads.ncdc.noaa.gov



NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.