[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [thredds] GRIB files, featureCollection, mixed tables and ncml



Hmm, it should not have overwritten anything in content/thredds. I hope you have a backup and can restore.

the only thing i can think of is that there should be a zero-length file

tomcat/content/thredds.INIT

that tells the war file not to overwrite if its present.

maybe that got removed? if so, just touch it before starting again.

On 3/26/2013 9:57 AM, Roy Mendelssohn - NOAA Federal wrote:
I just noticed you overwrote my threddsConfig.xml also, and the one in there 
looks a lot different.  Let me see if changing that changes things.

-Roy

On Mar 26, 2013, at 8:55 AM, Roy Mendelssohn - NOAA Federal <address@hidden> 
wrote:

Hi John:

The new version kills both of my featureCollections - the one that is wwas 
working and the one that was not.  When go to the second level catalog, where 
these datasets really exists, it shows nothing.  Even more, for some reason on 
the install it overwrote my catalog.xml  (possibly other files).

-Roy

On Mar 25, 2013, at 4:04 PM, Roy Mendelssohn - NOAA Federal <address@hidden> 
wrote:

Thanks I am out the door to coach, but ail try tomorrow.

-Roy

On Mar 25, 2013, at 3:53 PM, John Caron <address@hidden> wrote:

Hi Roy:

1) get latest 4.3.17 thredds.war:

ftp://ftp.unidata.ucar.edu/pub/thredds/4.3/4.3.17/thredds.war


2) for just the datasets with this problem, replace:

<gribConfig datasetTypes="Best LatestFile" />

in the catalog.xml with:

<gribConfig datasetTypes="Best LatestFile">

<pdsHash>
  <useTableVersion>false</useTableVersion>
</pdsHash>

</gribConfig>

3. delete the *.ncx files associated with that dataset (gbx9 are ok)

4. restart, let it reindex, and then try accessing that dataset.

lemmw know if you see any problems

On 3/25/2013 3:27 PM, Roy Mendelssohn - NOAA Federal wrote:
Thanks for any help, though technically what you are doing is correct.  If the 
tables are different the whole shebang might be different  (why I love external 
tables, I know you share the joy), but in our case it is not.  This is more 
carelessness from our data provider, because there is no reason for the table 
to be different (supposedly it is the same code generating the file as part of 
a routine process - go figure that one).  If we can do a workaround in ncml we 
will.  We just figured out how to do the VIIRS hdf4 files in a workable manner, 
that aggregate and update, so we have gotten pretty good with ncml.

Thanks again for any help you can provide or any suggestions as to what we can 
do.

-Roy


On Mar 25, 2013, at 2:12 PM, John Caron <address@hidden> wrote:

Hi Roy:

Im working on a workaround, as soon as I can get around to working ;^)

John

On 3/25/2013 1:02 PM, Roy Mendelssohn - NOAA Federal wrote:
HI All:

We are having again having a problem that arose a couple of months ago with aggregating our 
grub files using <featureCollection type="GRIB">.  The problem arises because 
we get the following error when trying to access the aggregation:

Error {
   code = 500;
   message = "Variable name (pres_msl) must be unique within Group ";
};

and this problem is caused by the following (thanks Ethan et al. for figuring this out):


it looks like the files are using two different versions of the same grib table. In the wgrib output for some files says: ... center 58 subcenter 0 process 58 Table 2 scan: WE:SN winds(N/S) ...

but for some others:
...
center 58 subcenter 0 process 58 Table 3 scan: WE:SN winds(N/S)

Now my question has to do with how your grib reader works, how that interacts with featureCollection, and how ncml files are viewed. What if for each file I created an ncml file that created a new variable that is basically the same one in the grib file, but because it is "new" it wouldn't be seen as different . Now my question is how would the resulting virtual file be viewed by TDS. Would it still be seen as a "grib" file and therefore aggregated using featureCollection, or is it now viewed as a netcdf file and aggregated using a aggregation scan, or will this not work at all?

We are supplied the files, and unfortunately don't have a good capability to 
rewrite the grib files, so are looking for a workaround.

Thanks,

-Roy

**********************
"The contents of this message do not reflect any position of the U.S. Government or 
NOAA."
**********************
Roy Mendelssohn
Supervisory Operations Research Analyst
NOAA/NMFS
Environmental Research Division
Southwest Fisheries Science Center
1352 Lighthouse Avenue
Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.

_______________________________________________
thredds mailing list
address@hidden
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/


_______________________________________________ thredds mailing list address@hidden For list information or to unsubscribe, visit: http://www.unidata.ucar.edu/mailing_lists/

********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center 1352 Lighthouse Avenue Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.


********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center 1352 Lighthouse Avenue Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.


********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center 1352 Lighthouse Avenue Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.


********************** "The contents of this message do not reflect any position of the U.S. Government or NOAA." ********************** Roy Mendelssohn Supervisory Operations Research Analyst NOAA/NMFS Environmental Research Division Southwest Fisheries Science Center 1352 Lighthouse Avenue Pacific Grove, CA 93950-2097

e-mail: address@hidden (Note new e-mail address)
voice: (831)-648-9029
fax: (831)-648-8440
www: http://www.pfeg.noaa.gov/

"Old age and treachery will overcome youth and skill."
"From those who have been given much, much will be expected"
"the arc of the moral universe is long, but it bends toward justice" -MLK Jr.



NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.