Michael,
I had turned off the LDM and the files were not being purged. I have a 1 TB
SSD drive. It appears there were two main culprits: grid (460G) and radar
(395G).
Searching the log files it appears all of the feed types were exceeding
their failure limit.
Just reset the purge via your command, but it doesn’t appear to have made a
difference in purge behavior of grid and radar in the last hour. Other
purge threads appear to be operating normally. Looking at the purge log
file, I don’t see any reference to purging the grid or radar threads.
-Kevin
On 14 August 2017 at 7:14:10 PM, Michael James (mjames@xxxxxxxx) wrote:
Are you certain that hdf5 files are being retained longer than their purge
files specify? What size disk is filling up?
You can run "du -h" on any of the hdf5/ subdirectories (such as satellite,
radar, grid) to see if any of these are unusually large. If, for example,
the satellite directory is taking up the bulk of space in
/awips2/edex/data/hdf5, we can check the satellitePurgeRules.xml first to
confirm the rules exist, and then check the edex-ingest-purge log for any
telltale messages:
grep ERROR /awips2/edex/log/edex-ingest-purge-20170815.log
For example, some data plugins may encounter an error which will disable
purging and print a message to edex-ingest-purge such as:
ERROR 2017-08-15 00:00:00,025 3622 [DefaultQuartzScheduler_Worker-3]
PurgeLogger: EDEX - SATELLITE::Purger for this plugin has reached or
exceeded consecutive failure limit of 3. Data will no longer being purged
for this plugin.
The workaround if you see this error message is the following command (as
root):
edex purge reset
Michael James
Unidata Program Center
Boulder, CO
On Mon, Aug 14, 2017 at 4:48 PM, Kevin Goebbert <kevin.goebbert@xxxxxxxxx>
wrote:
> Dave,
>
> I am having a similar issue…thanks for reporting! I haven’t had any luck
> finding a solution either.
>
> Regards,
> Kevin
>
> On 14 August 2017 at 5:38:18 PM, David Fitzgerald (
> david.fitzgerald@xxxxxxxxxxxxxxxx) wrote:
>
> Hello everyone,
>
>
>
> I am having trouble getting the data in /awips2/edex/data/hdf5 to purge;
> this of course causes the disk to fill up quite rapidly. I modified the
> xml files in /awips2/edex/data/utility/common_static/base/purge but have
> not seen any change. I also do not see any references to the hdf5
> directory in the edex-ingest-purge logs either. Could someone point me in
> the right direction to start debugging this? Are there other files to
> modify other than in /awips2/edex/data/utility/common_static/base/purge?
>
>
>
> Thanks!
>
>
>
> Dave
>
>
>
> +++++++++++++++++++++++++++
>
> David Fitzgerald
>
> Department of Earth Science
>
> Millersville University
>
> Millersville, PA 17551
>
>
>
> 717-871-7436 <(717)%20871-7436>
>
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web. Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> awips2-users mailing list
> awips2-users@xxxxxxxxxxxxxxxx
> For list information, to unsubscribe, or change your membership options,
> visit: http://www.unidata.ucar.edu/mailing_lists/
>
> --
> Kevin Goebbert, Ph.D.
> Associate Professor of Meteorology
> Kallay-Christopher Hall, 201-F
> 1809 Chapel Drive
> Valparaiso, IN 46383
>
> (219) 464-5517 <//(219)%20464-5517>
> fax: (219) 548-7738 <//(219)%20548-7738>
>
> https://kevingoebbert.youcanbook.me/
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are
> recorded in the Unidata inquiry tracking system and made publicly
> available through the web. Users who post to any of the lists we
> maintain are reminded to remove any personal information that they
> do not want to be made public.
>
>
> awips2-users mailing list
> awips2-users@xxxxxxxxxxxxxxxx
> For list information, to unsubscribe, or change your membership options,
> visit: http://www.unidata.ucar.edu/mailing_lists/
>
>
_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web. Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.
awips2-users mailing list
awips2-users@xxxxxxxxxxxxxxxx
For list information, to unsubscribe, or change your membership options,
visit: http://www.unidata.ucar.edu/mailing_lists/
--
Kevin Goebbert, Ph.D.
Associate Professor of Meteorology
Kallay-Christopher Hall, 201-F
1809 Chapel Drive
Valparaiso, IN 46383
(219) 464-5517 <//(219)%20464-5517>
fax: (219) 548-7738 <//(219)%20548-7738>
https://kevingoebbert.youcanbook.me/
