Re: [awips2-users] hdf5 purging

Are you certain that hdf5 files are being retained longer than their purge
files specify?  What size disk is filling up?

You can run "du -h" on any of the hdf5/ subdirectories (such as satellite,
radar, grid) to see if any of these are unusually large.  If, for example,
the satellite directory is taking up the bulk of space in
/awips2/edex/data/hdf5, we can check the satellitePurgeRules.xml first to
confirm the rules exist, and then check the edex-ingest-purge log for any
telltale messages:

grep ERROR /awips2/edex/log/edex-ingest-purge-20170815.log

For example, some data plugins may encounter an error which will disable
purging and print a message to edex-ingest-purge such as:

ERROR 2017-08-15 00:00:00,025 3622 [DefaultQuartzScheduler_Worker-3]
PurgeLogger: EDEX - SATELLITE::Purger for this plugin has reached or
exceeded consecutive failure limit of 3.  Data will no longer being purged
for this plugin.

The workaround if you see this error message is the following command (as
root):

edex purge reset



Michael James
Unidata Program Center
Boulder, CO

On Mon, Aug 14, 2017 at 4:48 PM, Kevin Goebbert <kevin.goebbert@xxxxxxxxx>
wrote:

> Dave,
>
> I am having a similar issue…thanks for reporting! I haven’t had any luck
> finding a solution either.
>
> Regards,
> Kevin
>
> On 14 August 2017 at 5:38:18 PM, David Fitzgerald (
> david.fitzgerald@xxxxxxxxxxxxxxxx) wrote:
>
> Hello everyone,
>
>
>
> I am having trouble getting the data in /awips2/edex/data/hdf5 to purge;
> this of course causes the disk to fill up quite rapidly.  I modified the
> xml files in /awips2/edex/data/utility/common_static/base/purge but have
> not seen any change.  I also do not see any references to the  hdf5
> directory  in the edex-ingest-purge logs either.  Could someone point me in
> the right direction to start debugging this?  Are there other files to
> modify other than in /awips2/edex/data/utility/common_static/base/purge?
>
>
>
> Thanks!
>
>
>
> Dave
>
>
>
> +++++++++++++++++++++++++++
>
> David Fitzgerald
>
> Department of Earth Science
>
> Millersville University
>
> Millersville, PA 17551
>
>
>
> 717-871-7436 <(717)%20871-7436>
>
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web. Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> awips2-users mailing list
> awips2-users@xxxxxxxxxxxxxxxx
> For list information, to unsubscribe, or change your membership options,
> visit: http://www.unidata.ucar.edu/mailing_lists/
>
> --
> Kevin Goebbert, Ph.D.
> Associate Professor of Meteorology
> Kallay-Christopher Hall, 201-F
> 1809 Chapel Drive
> Valparaiso, IN 46383
>
> (219) 464-5517 <//(219)%20464-5517>
> fax: (219) 548-7738 <//(219)%20548-7738>
>
> https://kevingoebbert.youcanbook.me/
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web.  Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> awips2-users mailing list
> awips2-users@xxxxxxxxxxxxxxxx
> For list information, to unsubscribe, or change your membership options,
> visit: http://www.unidata.ucar.edu/mailing_lists/
>
>
  • 2017 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the awips2-users archives: