[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #MIY-170840]: One of our two LDM servers is having problems

Jennifer,

What are the pqact(1) configuration-file entries for the "data/dds/sa/*.sa" 
files?

What is the output of the command "ulimit -a" on the two systems?

> We have two LDM servers running, one on a server known as 
> ‘cola.gmu.edu<http://cola.gmu.edu>', the other on 
> ‘colaweb.gmu.edu<http://colaweb.gmu.edu>’. We recently updated the OS on 
> colaweb from CentOS5 to CentOS7 and are dealing with the fallout.
> 
> We updated the The LDM from version 6.7.0 to 6.13.6. The ldmd.conf files are 
> identical, here are the relevant entries:
> 
> REQUEST IDS|DDPLUS ".*" idd.meteo.psu.edu<http://idd.meteo.psu.edu>
> REQUEST IDS|DDPLUS ".*” idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>
> REQUEST FNEXRAD "^radar_mosaic" idd.meteo.psu.edu<http://idd.meteo.psu.edu>
> REQUEST FNEXRAD "^radar_mosaic" 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>
> REQUEST NIMAGE " TIG[NE]" idd.meteo.psu.edu<http://idd.meteo.psu.edu>
> REQUEST NIMAGE " TIG[NE]" idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>
> 
> The new LDM is up and running, but the dds data (in particular the files in 
> $LDMHOME/data/dds/sa/*.sa) are not what they should be. Here is a screenshot 
> of the output from ‘ls -l’ on both servers:
> 
> [cid:AA6ECC7E-202C-4B3A-803C-58E0344FC22B@mesa.gmu.edu]
> 
> The new server (colaweb, shown in blue) does not seem to be writing out the 
> all the metars (the files are smaller than they should be), and it is lagging 
> behind the old server (cola, shown in green). I had restarted the new LDM 
> earlier this morning (~10am EDT), and at that time I copied the *.sa files 
> over from the old server, but since then it is not keeping up. Note we do not 
> even have a data file for 2017051614 on the new server.
> 
> Both servers agree on what time it is — the output from ‘date’ command is the 
> same on both servers.
> 
> The text below is the tail of $LDMHOME/var/logs/ldmd.log on colaweb:
> 
> 20170516T153625.287502Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13391] 
> NOTE ldm_config_file.c:799:requester_exec() Switching data-product 
> transfer-mode to primary
> 20170516T153625.291690Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13391] 
> NOTE requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516143625.291658 TS_ENDT {{FNEXRAD, "^radar_mosaic"},{NONE, 
> "SIG=5537991c130ccf92355783bd7c2220b4"}}
> 20170516T153625.415062Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13391] 
> NOTE requester6.c:311:make_request() Upstream LDM-6 on 
> idd.meteo.psu.edu<http://idd.meteo.psu.edu> is willing to be a primary feeder
> 20170516T154217.422329Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> ldm_config_file.c:799:requester_exec() Switching data-product transfer-mode 
> to alternate
> 20170516T154217.422621Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144217.422593 TS_ENDT {{NIMAGE, " TIG[NE]"},{NONE, 
> "SIG=81883cc627625c81b937feae866750a5"}}
> 20170516T154217.559098Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> requester6.c:311:make_request() Upstream LDM-6 on 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu> is willing to be an 
> alternate feeder
> 20170516T154223.565215Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE ldm_config_file.c:799:requester_exec() Switching data-product 
> transfer-mode to primary
> 20170516T154223.597208Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144223.597168 TS_ENDT {{NIMAGE, " TIG[NE]"},{NONE, 
> "SIG=81883cc627625c81b937feae866750a5"}}
> 20170516T154223.701571Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE requester6.c:311:make_request() Upstream LDM-6 on 
> idd.meteo.psu.edu<http://idd.meteo.psu.edu> is willing to be a primary feeder
> 20170516T154615.192116Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13391] 
> NOTE error.c:236:err_log() Upstream LDM died: pid=22678
> 20170516T154615.216336Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13391] 
> NOTE requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144615.216307 TS_ENDT {{FNEXRAD, "^radar_mosaic"},{NONE, 
> "SIG=e11ddb4592b26074b5bde507415fc5d4"}}
> 20170516T154615.349357Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13391] 
> NOTE requester6.c:311:make_request() Upstream LDM-6 on 
> idd.meteo.psu.edu<http://idd.meteo.psu.edu> is willing to be a primary feeder
> 20170516T154703.361688Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> error.c:236:err_log() Upstream LDM died: pid=5470
> 20170516T154703.374044Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144703.374001 TS_ENDT {{NIMAGE, " TIG[NE]"},{NONE, 
> "SIG=615350098cf5c838d74dad473891d850"}}
> 20170516T154703.509048Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> requester6.c:311:make_request() Upstream LDM-6 on 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu> is willing to be an 
> alternate feeder
> 20170516T154715.284917Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE error.c:236:err_log() Upstream LDM died: pid=19084
> 20170516T154715.320205Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144715.320185 TS_ENDT {{NIMAGE, " TIG[NE]"},{NONE, 
> "SIG=615350098cf5c838d74dad473891d850"}}
> 20170516T154715.400357Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE requester6.c:311:make_request() Upstream LDM-6 on 
> idd.meteo.psu.edu<http://idd.meteo.psu.edu> is willing to be a primary feeder
> 20170516T154719.353322Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13392] NOTE 
> error.c:236:err_log() Upstream LDM died: pid=2536
> 20170516T154719.421799Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13392] NOTE 
> requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144719.421750 TS_ENDT {{FNEXRAD, "^radar_mosaic"},{NONE, 
> "SIG=e11ddb4592b26074b5bde507415fc5d4"}}
> 20170516T154719.557119Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13392] NOTE 
> requester6.c:311:make_request() Upstream LDM-6 on 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu> is willing to be an 
> alternate feeder
> 20170516T154915.673552Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE ldm_config_file.c:799:requester_exec() Switching data-product 
> transfer-mode to alternate
> 20170516T154915.673723Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144915.673702 TS_ENDT {{NIMAGE, " TIG[NE]"},{NONE, 
> "SIG=9f00aea615561deb2f972fe5d1029d4c"}}
> 20170516T154915.753278Z idd.meteo.psu.edu<http://idd.meteo.psu.edu>[13393] 
> NOTE requester6.c:311:make_request() Upstream LDM-6 on 
> idd.meteo.psu.edu<http://idd.meteo.psu.edu> is willing to be an alternate 
> feeder
> 20170516T154916.642526Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> ldm_config_file.c:799:requester_exec() Switching data-product transfer-mode 
> to primary
> 20170516T154916.680295Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> requester6.c:588:req6_new() LDM-6 desired product-class: 
> 20170516144916.680262 TS_ENDT {{NIMAGE, " TIG[NE]"},{NONE, 
> "SIG=9f00aea615561deb2f972fe5d1029d4c"}}
> 20170516T154916.816037Z 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu>[13394] NOTE 
> requester6.c:311:make_request() Upstream LDM-6 on 
> idd.unidata.ucar.edu<http://idd.unidata.ucar.edu> is willing to be a primary 
> feeder
> 
> 
> I don’t know how to interpret this logfile output. Please let me know if 
> there is more diagnostic info I can give you. I am considering dropping back 
> to the older version and recompiling that on the new server just to factor 
> out differences in the LDM software itself. Is there anything else we should 
> try?

Regards,
Steve Emmerson

Ticket Details
===================
Ticket ID: MIY-170840
Department: Support LDM
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.