Re: [thredds] Join Existing aggregations with ncml in TDS 4.2 and 4.3

Hi John,

Thanks.  We did not find a cache file that matched when we grepped for the
number.  We probably cleared the cache at some point.  We will experiment
with recreating the problem which likely came up by running a 4.2 server
then upgrading to 4.3 without clearing the contents of
content/thredds/cache in between.

Roland

On Sat, Feb 23, 2013 at 4:08 PM, John Caron <caron@xxxxxxxxxxxxxxxx> wrote:

> Hi Roland:
>
> It looks like a caching problem.
>
> go into {tomcat_home}/thredds/content/cache/agg/
>
> and grep for "1405627963". If you find it, send me that file.
>
> John
>
> On 1/10/2013 1:05 PM, Roland Schweitzer - NOAA Affiliate wrote:
> > Hi,
> >
> > In TDS version 4.2.5 - 20110302.2315 we would do aggregations with this
> > sort of ncml specification and things worked as we expected, but with
> > TDS Version 4.3.15 - 20121218.1126 when use the exact same catalog we
> > get the following error:
> >
> > Error {
> >      code = 500;
> >      message = "
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
>  is not a valid URL, return status=400";
> > };
> >
> >
> > 2013-01-10T12:01:00.718 -0800 [    971459][      22] ERROR -
> thredds.server.opendap.OpendapServlet - path=
> /Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation.html
> > java.io.IOException:
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc#1405627963
>  is not a valid URL, return status=400
> >          at
> ucar.nc2.dataset.NetcdfDataset.disambiguateHttp(NetcdfDataset.java:725)
> >          at
> ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:674)
> >          at
> ucar.nc2.dataset.NetcdfDataset.acquireFile(NetcdfDataset.java:628)
> >          at
> ucar.nc2.ncml.Aggregation$Dataset.acquireFile(Aggregation.java:634)
> >          at
> ucar.nc2.ncml.AggregationExisting.buildNetcdfDataset(AggregationExisting.java:74)
> >
> >          [...]
> >
> >
> > I know FMRC aggregations changed, but I thought something along the
> lines of the catalog below would still work in 4.3.  What's the right way
> to do this sort of aggrgation in 4.3?
> >
> > Roland
> >
> >
> > <?xml version="1.0" encoding="UTF-8"?>
> > <catalog
> > xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
> > xmlns:xlink="http://www.w3.org/1999/xlink"; version="1.0.1">
> >    <service name="compound" serviceType="compound" base="">
> >      <service name="dods" base="/thredds/dodsC/" serviceType="OPeNDAP" />
> >    </service>
> >    <dataset name="pressure"
> > ID="PSDgriddedData/ncep.reanalysis2.dailyavgs/pressure">
> >      <metadata inherited="true">
> >        <dataType>GRID</dataType>
> >      </metadata>
> >      <dataset name="air"
> > ID="PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc
> > <http://PSDgriddedData.ncep.reanalysis2.dailyavgs.pressure.air.1979.nc>"
> > urlPath="Datasets/ncep.reanalysis2.dailyavgs/pressure/air_aggregation">
> >        <documentation type="Notes"
> > xlink:href="
> http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html
> "
> > xlink:title="Aggregated from catalog
> >
> http://www.esrl.noaa.gov/psd/thredds/catalog/Datasets/ncep.reanalysis2.dailyavgs/pressure/catalog.html
> > starting with
> >
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure
> "
> > />
> >        <property name="eastwestPropertyNumberOfPoints" value="144" />
> >        <property name="eastwestResolution" value="2.5" />
> >        <property name="eastwestStart" value="0.0" />
> >        <property name="northsouthPropertyNumberOfPoints" value="73" />
> >        <property name="northsouthResolution" value="2.5" />
> >        <property name="northsouthStart" value="-90.0" />
> >        <property name="updownValues" value="1000.0 925.0 850.0 700.0
> > 600.0 500.0 400.0 300.0 250.0 200.0 150.0 100.0 70.0 50.0 30.0 20.0
> 10.0" />
> >        <property name="hasZ" value="air" />
> >        <property name="hasT" value="air" />
> >        <property name="timeAxisUnits" value="hours since 1800-1-1
> > 00:00:0.0" />
> >        <property name="timeCoverageStart" value="1979-01-01 00:00:00Z" />
> >        <property name="timeCoverageNumberOfPoints" value="12235" />
> >        <timeCoverage>
> >          <start>1979-01-01 00:00:00Z</start>
> >          <end>1982-12-31 00:00:00Z</end>
> >        </timeCoverage>
> >        <geospatialCoverage zpositive="down">
> >          <northsouth>
> >            <start>-90.0</start>
> >            <size>180.0</size>
> >            <units>degrees_north</units>
> >          </northsouth>
> >          <eastwest>
> >            <start>0.0</start>
> >            <size>357.5</size>
> >            <units>degrees_east</units>
> >          </eastwest>
> >          <updown>
> >            <start>10.0</start>
> >            <size>990.0</size>
> >            <units>millibar</units>
> >          </updown>
> >        </geospatialCoverage>
> >        <serviceName>compound</serviceName>
> >        <metadata inherited="true">
> >          <variables vocabulary="netCDF_contents">
> >            <variable name="air" units="degK" vocabulary_name="Daily Air
> > Temperature on Pressure Levels" />
> >          </variables>
> >        </metadata>
> >        <dataSize units="Mbytes">130.4</dataSize>
> >        <date type="modified">2011-06-14 00:26:25Z</date>
> >        <netcdf
> > xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
> >          <aggregation type="joinExisting" dimName="time">
> >            <netcdf
> > location="
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1979.nc
> "
> > ncoords="365" />
> >            <netcdf
> > location="
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1980.nc
> "
> > ncoords="366" />
> >            <netcdf
> > location="
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1981.nc
> "
> > ncoords="365" />
> >            <netcdf
> > location="
> http://www.esrl.noaa.gov/psd/thredds/dodsC/Datasets/ncep.reanalysis2.dailyavgs/pressure/air.1982.nc
> "
> > ncoords="365" />
> >          </aggregation>
> >        </netcdf>
> >      </dataset>
> >    </dataset>
> > </catalog>
> >
> >
> > _______________________________________________
> > thredds mailing list
> > thredds@xxxxxxxxxxxxxxxx
> > For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
> >
>
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
>
  • 2013 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: