Re: [ldm-users] LDM log message

On Tue, 2 Jun 2009, Michael E Masscotte wrote:

Does anyone know what the following means in the ldm log file?:

pqact[1417] WARN: Processed oldest product in queue: 1468.15 s

I've seen it a few times and don't quite understand what that message is trying to say and looking in the source didn't reveal much...

Hi Mike,

It means that you need a bigger queue or you need to split your pqact.conf file up into smaller chunks. pqact keeps a pointer in the LDM queue as it fills up. A single pqact can only process 32 things at a time, so if your disk slows down or ingestors slow down, pqact may start getting behind. The warning message means that the pqact pointer into the queue processed the oldest file in the queue, which is not good. You want it up at the front processing products immediately as they enter the queue.

Since pqact is at the oldest product, it may get bumped ahead in the queue to 'catch up' and thus miss products IIRC...

The answer is to look into splitting pqact.conf up into smaller files and then invoking multiple pqact's in ldmd.conf like so:

EXEC    "pqact etc/pqact.conf"
EXEC    "pqact etc/pqact-afos.conf"
EXEC    "pqact pyWWA/pqact.conf"


daryl

--
/**
 * Daryl Herzmann
 * Assistant Scientist -- Iowa Environmental Mesonet
 * http://mesonet.agron.iastate.edu
 */



  • 2009 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: