Question about odd TDS behavior on lead4

[Robb Kambic]

hiya,

the script wasn't working at all because the grib.jar was not on lead4 and
the reference to java was wrong. the logs said files were indexed but that
was incorrect because the script can't catch errors from forked processes
so it couldn't give an error message. it will be a couple of hours before
all the indexing is caught up.

robb...





On Wed, 17 May 2006, Tom Baltzer wrote:

> Hi Robb,
>
> My question was about scour/ManageFilesDirs deleting symlinks rather than
> GribIndexer following symlinks.
>
> This situation seems to be confined to the specific files 20060516_12 and
> 20060516_18 and persists for those files.  It does not continue for more
> recently received files...  I'm not sure what to make of it...
>
>
> Thanks,
> Tom.
>
> > -----Original Message-----
> > From: Robb Kambic [mailto:rkambic at unidata.ucar.edu]
> > Sent: Tuesday, May 16, 2006 6:23 PM
> > To: Tom Baltzer
> > Cc: 'John Caron'; robb at unidata.ucar.edu
> > Subject: RE: Question about odd TDS behavior on lead4
> >
> > On Tue, 16 May 2006, Tom Baltzer wrote:
> >
> > > Hi again guys,
> > >
> > > I just checked into the GribIndexer.conf file and found it was pointing
> > to
> > > the wrong place.  I've modified that now... though I don't think that
> > fully
> > > explains what's going on.
> >
> > Tom,
> >
> > if the indexer is pointed at the top level directory it will crawl
> > the sub directories but not links.  tom, did you change it to crawl links?
> > i remember that you asked me about crawling links.  i'll log into lead4
> > tomorrow and take a look.  i don't think it a version problem with the
> > indexer but i'll check it out.
> >
> > robb...
> >
> > >
> > > Thanks,
> > > Tom.
> > >
> > > > -----Original Message-----
> > > > From: John Caron [mailto:caron at unidata.ucar.edu]
> > > > Sent: Tuesday, May 16, 2006 3:12 PM
> > > > To: Tom Baltzer; robb at unidata.ucar.edu
> > > > Subject: Re: Question about odd TDS behavior on lead4
> > > >
> > > > Tom, can you check how often the grib indexing is running? if not
> > sure,
> > > > ask robb
> > > >
> > > > Tom Baltzer wrote:
> > > >
> > > > > Hi Guys,
> > > > >
> > > > > I've been encountering a peculiar behavior on lead4 when trying to
> > > > > access the most recent NAM grib files. Basically, I am not seeing
> > all
> > > > > the time stamps show up though the file size indicates that they
> > > > > should be there and the motherlode TDS is serving them up fine.
> > > > >
> > > > > E.g. See:
> > > > >
> > > >
> > http://lead4.unidata.ucar.edu:8080/thredds/dodsC/model/NCEP/NAM/CONUS_40km
> > > > /conduit/NAM_CONUS_40km_conduit_20060516_1200.grib1
> > > > >
> > > > > As compared with:
> > > > >
> > > >
> > http://motherlode.ucar.edu:8080/thredds/dodsC/model/NCEP/NAM/CONUS_40km/co
> > > > nduit/NAM_CONUS_40km_conduit_20060516_1200.grib1
> > > > >
> > > > > The listings of these files seems to indicate that both are complete
> > -
> > > > > First from lead4:
> > > > >
> > > > > [root at lead4 conduit]# ls -l
> > NAM_CONUS_40km_conduit_20060516_1200.grib1
> > > > >
> > > > > -rw-rw-r-- 1 ldm leadstaff 446221772 May 16 08:37
> > > > > NAM_CONUS_40km_conduit_20060516_1200.grib1
> > > > >
> > > > > And from motherlode:
> > > > >
> > > > >> ls -l NAM_CONUS_40km_conduit_20060516_1200.grib1
> > > > >
> > > > > -rw-rw-r-- 1 ldm ustaff 446221772 May 16 08:57
> > > > > NAM_CONUS_40km_conduit_20060516_1200.grib1
> > > > >
> > > > > What is particularly peculiar is that older files appear fine as
> > > > > though they need to age for a while (like fine wine?)
> > > > >
> > > > > Have you any thoughts?
> > > > >
> > > > > Thanks,
> > > > > Tom.
> > > > >
> > > > > Tom Baltzer
> > > > >
> > > > > Software Engineer
> > > > >
> > > > > UCAR Office of Programs
> > > > > Unidata Program Center
> > > > > P.O. Box 3000
> > > > > Boulder, CO 80307-3000
> > > > >
> > > > > E-mail: tbaltzer at ucar.edu
> > > > >
> > > > > Phone: 303-497-8637
> > > > >
> > >
> > >
> > >
> > >

==============================================================================
Robb Kambic        			   Unidata Program Center
Software Engineer III			   Univ. Corp for Atmospheric Research
rkambic at unidata.ucar.edu		   WWW: http://www.unidata.ucar.edu/
==============================================================================