Re: 20030714: ldmadmin scour ignore option?

Jared,

I've run into similar problems here too and have usually written a custom
script to handle it.  As far as I know, I don't think it deletes
directories either which is a problem with dated directories which
accumulate over time and then bog down the "find" command which it uses
for deletion.  I've had cases on a busy system where so many nested
directories have accumulated (because I forgot to remove them manually)
that one scour doesn't finish before the next one begins and it eventually
brings the system down.  I've had fantasies of making some improvements to
the scour script but (like all of us) haven't yet found the time.

                                 Art.

On Mon, 14 Jul 2003, Jared P Bostic wrote:

> > Yes.  You configure scouring by setting directories and file name
> > masks in the ~ldm/etc/scour.conf file.  To not scour a directory,
> > simply don't include it in your scour.conf.
>
>
> Tom (and everyone),
>
> Thanks - that's what we're doing now.  Guess I wasn't really clear
> (sorry!).  My situation is the following...
>
> Say for example one was saving incoming files in the following way:
>
> /mnt/ldm/data/YYYY/mm/dd/YYYYmmdd.txt
>
> where YYYY = 4 digit year, mm = 2 digit month, dd = 2 digit day
>
> Ok, say I only want to keep /mnt/ldm/data from filling up, yet
> don't want to delete files from certain directories,
> eg. 1999/05/03 (wouldn't have any idea why I picked that date :-P
> Obviously, if I just put /mnt/local/data in the scour.conf, the
> pattern would get applied to everything in there, and the case
> study days would get nuked.  I suppose one could write a cron
> script to create a new scour.conf file each day with that day's
> YYYY/mm/dd in it, to add that to the end of the root data dir
> on the appropriate line in the file. Alternatively, one could
> have a script that added certain (protected) days' patterns to
> a "NOT" condition in the regular expression (maybe?).  My basic
> question is: does anyone have experience with this sort of issue
> and is there a solution (other than what I've mentioned) for this?
>
> Thanks Again!
>
> Jared Bostic
> OCS/Oklahoma Mesonet
>
>
> > >In my case, I'd like to keep some case study data in the same directory
> > >as some stuff that needs to be scoured.  Is there a way to tell scour
> > >to ignore something, for example, over a certain age or as listed in
> > >some kind of .ignore pattern action or file (a la CVS)?
> >
> > There is no 'ignore' pattern, but you can specify a simple regular
> > expression as the pattern for files you do want to scour.  The files
> > you want to keep would, therefore, have to be named so that they don't
> > match the pattern.
> >
> > >Any help appreciated!
> > >
> > >Jared Bostic
> > >OCS/Oklahoma Mesonet
> > >--
> > >----------------------------------------------------
> > >Jared P. Bostic
> > >Oklahoma Climatological Survey Operations Center
> > >Email:     jpbostic@xxxxxxxxxxxxxxxxxxxxx
> > >USmail: 100 East Boyd, Suite 1210, Norman, OK  73019
> > >Phone: (405) 325-3231 / Pager: (405) 530-4478
> > >Fax:   (405) 325-2550
> > >----------------------------------------------------
> >
> > Tom
> > --
> > +-----------------------------------------------------------------------------+
> > * Tom Yoksas                                             UCAR Unidata 
> > Program *
> > * (303) 497-8642 (last resort)                                  P.O. Box 
> > 3000 *
> > * yoksas@xxxxxxxxxxxxxxxx                                   Boulder, CO 
> > 80307 *
> > * Unidata WWW Service                             
> > http://www.unidata.ucar.edu/*
> > +-----------------------------------------------------------------------------+
> >
>
> --
> ----------------------------------------------------
> Jared P. Bostic
> Oklahoma Climatological Survey Operations Center
> Email:        jpbostic@xxxxxxxxxxxxxxxxxxxxx
> USmail: 100 East Boyd, Suite 1210, Norman, OK  73019
> Phone: (405) 325-3231 / Pager: (405) 530-4478
> Fax:   (405) 325-2550
> ----------------------------------------------------
>

Arthur A. Person
Research Assistant, System Administrator
Penn State Department of Meteorology
email:  person@xxxxxxxxxxxxxxxxxx, phone:  814-863-1563


  • 2003 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: