[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: FeatureCollection error



John,

1)  Your right, the deployment method I was
        using was not removing the old installation.
        I fixed this and am now actually running the 4.2.5
        on dev.

2)   I did not have an old threddsConfig.xml
I attempted it both with and with-out the  <FeatureCollection>
directory specified.  Both resulted in an NPE below.
I am going to try it different set of files.

=======================================================================
2011-04-13T14:37:36.073 -0400 [      7360][       9] INFO  -
thredds.server.catalogservice.LocalCatalogServiceController -
handleRequestInternal(): Remote host: <> - Request: "GET
/thredds/catalog/fmrc/nam-master//catalog.html HTTP/1.1"
2011-04-13T14:37:36.109 -0400 [      7396][       9] ERROR -
thredds.server.catalogservice.LocalCatalogServiceController -
handleRequestInternal(): Problem handling request.
java.lang.NullPointerException
    at
thredds.catalog.InvDatasetFeatureCollection.makeVirtualService(InvDatasetFeatureCollection.java:252)
    at thredds.catalog.InvDatasetFcFmrc.checkState(InvDatasetFcFmrc.java:87)
    at
thredds.catalog.InvDatasetFeatureCollection.getRawFileScan(InvDatasetFeatureCollection.java:233)
    at
thredds.servlet.DataRootHandler.getMatchingScan(DataRootHandler.java:1139)
    at
thredds.servlet.DataRootHandler.getMatchingProxyDataset(DataRootHandler.java:1116)
    at
thredds.servlet.DataRootHandler.isProxyDatasetResolver(DataRootHandler.java:1108)
    at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1473)
    at
thredds.server.catalogservice.LocalCatalogServiceController.handleRequestInternal(LocalCatalogServiceController.java:196)
    at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
    at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
    at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:875)
    at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:809)
    at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:571)
    at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:501)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:690)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
thredds.servlet.filter.CatalogServiceFilter.doFilter(CatalogServiceFilter.java:107)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
thredds.servlet.filter.RequestQueryFilter.doFilter(RequestQueryFilter.java:121)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
thredds.servlet.filter.RequestPathFilter.doFilter(RequestPathFilter.java:105)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
    at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
    at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:433)
    at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
    at
org.jstripe.tomcat.probe.Tomcat55AgentValve.invoke(Tomcat55AgentValve.java:20)
    at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
    at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:568)
    at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
    at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
    at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
    at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
    at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
    at java.lang.Thread.run(Thread.java:619)




        -Dan



john caron wrote the following on 4/11/2011 6:22 PM:
> 1) so the latest version should have this inside the war file:
> 
> CHANGES for THREDDS Data Server (TDS)
> Version 4.2.5
> Build Date = 2011-03-02 23:15:18
> Build Name = 5
> 
> can you make sure thats what you are using?
> 
> 2) this error message:
> 
> [2011-04-11T16:55:50.517-0400] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
> /home/nomads/tomcat-main/content/thredds/cache/collection Home
> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
> creation is not permitted, but there are no log files in the environment
> directory. Environment is invalid and must be closed.
>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>     at
> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>     at
> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
> 
> 
> implies that theres another process (server) thats running that is using
> the same directory:
> 
>  <FeatureCollection**>
>    <*dir*>/tomcat_home/content/thredds/collectionCache/</*dir*>
>  </FeatureCollection
> 
> 
> 
> if thats true, it may be because you've copied threddsConfig.xml, which
> has that directory in it. We now recommend that you dont use that
> element, so that it defaults to the local tomat directory.
> 
> see
> 
> http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.2/reference/ThreddsConfigXMLFile.html
> 
> 
> 
> On 4/11/2011 3:02 PM, Dan Swank wrote:
>> I am using the "latest 4.2 release" from the home-site.
>>
>> I also installed that block of xml from my last email
>>     into a fresh catalog.xml from the war.
>> Still no good.
>> This functionality seems great.. just gotta get it happy with something.
>> Is there anything outside catalog.xml you need to configure for it?
>>
>> This is the full contents of featureCollectionScan.log
>> ===========================================================
>>
>> [2011-04-11T16:55:19.514-0400] INFO
>> thredds.servlet.DataRootHandler.fcScan: Schedule startup scan for
>> /raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$
>> at Mon Apr 11 16:55:49 EDT 2011
>> [2011-04-11T16:55:19.530-0400] INFO
>> thredds.servlet.DataRootHandler.fcScan: Schedule recurring scan for
>> /raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$
>> cronExpr=0 5 3 * * ? *
>> [2011-04-11T16:55:49.530-0400] INFO
>> thredds.servlet.DataRootHandler.fcScan: Trigger scan for NCEP-NAM-Grid-218
>> [2011-04-11T16:55:50.268-0400] INFO
>> thredds.inventory.DatasetCollectionManager: NCEP-NAM-Grid-218: initial
>> scan found n datasets = 1218
>> [2011-04-11T16:55:50.517-0400] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>>     at
>> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>>     at
>> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
>>     at
>> thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
>>     at
>> thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
>>     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
>>     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
>>     at
>> thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
>>     at
>> thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
>>     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
>>     at
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
>> [2011-04-11T16:55:50.519-0400] ERROR ucar.nc2.ft.fmrc.Fmrc:
>> /raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$:
>> initial fmrcDataset creation failed
>> java.lang.RuntimeException:
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>
>>
>>
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:320)
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
>>     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
>>     at
>> thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
>>     at
>> thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
>>     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
>>     at
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
>> Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>>     at
>> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>>     at
>> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
>>     at
>> thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
>>     at
>> thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
>>     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
>>     ... 6 more
>> [2011-04-11T16:55:50.520-0400] ERROR
>> thredds.servlet.DataRootHandler.fcScan: InitFmrcJob failed
>> java.lang.RuntimeException: java.lang.RuntimeException:
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>
>>
>>
>>
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:251)
>>     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
>>     at
>> thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
>>     at
>> thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
>>     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
>>     at
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
>> Caused by: java.lang.RuntimeException:
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:320)
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
>>     ... 5 more
>> Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>>     at
>> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>>     at
>> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
>>     at
>> thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
>>     at
>> thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
>>     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
>>     ... 6 more
>>
>>               73,2-5        Bot
>>
>>
>>
>>
>>
>>
>> John Caron wrote the following on 4/11/2011 2:17 PM:
>>> i think its a bug that was fixed in the latest release (4.2.5)
>>>
>>> On 4/11/2011 11:21 AM, Dan Swank wrote:
>>>> I've been tinkering with the new FeatureCollection.
>>>> I keep getting this exception:
>>>> Any immediate ideas?
>>>> The dev server is 4.2.20101116.2051 - 20101116.2051
>>>>
>>>>
>>>> Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>>>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>>>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>>>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>>>> creation is not permitted, but there are no log files in the environment
>>>> directory. Environment is invalid and must be closed.
>>>>
>>>>
>>>> ====================================================================
>>>>
>>>> <featureCollection name="NCEP-NAM-Grid-218" featureType="FMRC"
>>>> harvest="true"
>>>>      path="fmrc/nam-test/">
>>>>
>>>>    <collection
>>>> spec="/raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$"
>>>>
>>>>            recheckAfter="30 min"  olderThan="5 min"/>
>>>>    <update startup="true" rescan="0 5 3 * * ? *" />
>>>>    <fmrcConfig regularize="true"  datasetTypes="TwoD" />
>>>>
>>>> </featureCollection>
>>>>
>>>>
> 

-- 
Dan Swank
STG, Incorporated - Government Contractor
NCDC-NOMADS Project:  Software & Data Management
Data Access Branch
National Climatic Data Center
Veach-Baley Federal Building
151 Patton Avenue
Asheville, NC 28801-5001
Email: address@hidden
Phone: 828-271-4007


NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.