Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.

Re: [ldm-users] NEXRAD3 & NEXRAD2

On Mon, 12 Apr 2010, Jeff Lake - Admin wrote:
I have been watching the server in my system that receives NEXRAD2 & 3 during our mini severe outbreak Easter Weekend it fell drastically behind in storing NEXRAD2 (on the tune of 30-45 minutes) at that time it had 4gb RAM on a 10Mbit port .. 

Jeff,
Do you have your pqact split across multiple files? Each pqact process can only take up 32 child processes, so if you have a busy system, pqact will wait for "slots" to open up before it can start a new write or process. So I do something like this in ldmd.conf 

exec    "pqact -p BZIP2/K[A-D] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[E-H] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[I-K] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[L-O] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[P-R] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/K[S-Z] -f CRAFT etc/pqact.CRAFT"
exec    "pqact -p BZIP2/[NTP] -f CRAFT etc/pqact.CRAFT"
Notice how the regex splits up the processing, eventhough I use the same pqact config file in each. 

daryl
  • 2010 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: