[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #RCA-822786]: Failover doesn't occur when primary feed goes down



Gilbert,

The log messages cover about 1.5 minutes rather than 5 minutes.

I didn't see "unidata.ucar.edu" in the messages. Would you please send me the 
output of the command "fgrep unidata.ucar.edu var/logs/ldmd.log" if it's not 
too large. I'd like to see any messages from the downstream LDM that's 
receiving NEXRAD3|WMO products from idd.unidata.ucar.edu.

> Sep 10 11:55:02 weather2 weather3.admin.niu.edu(feed)[32754] NOTE:
> Failure; COMINGSOON: RPC: Unable to receive; errno = Connection reset by
> peer
> Sep 10 11:55:02 weather2 10.80.4.14[20330] NOTE: Connection reset by peer
> Sep 10 11:55:02 weather2 10.80.4.14[20330] NOTE: [svc_tcp.c:361] read()
> error on socket 3
> Sep 10 11:55:02 weather2 10.80.4.14[20330] NOTE: one_svc_run(): RPC layer
> closed connection
> Sep 10 11:55:02 weather2 10.80.4.14[20330] NOTE: Connection to upstream
> LDM closed: pid=19898
> Sep 10 11:55:02 weather2 weather3.admin.niu.edu(feed)[32754] NOTE: Exiting
> Sep 10 11:55:02 weather2 10.80.4.14[20338] NOTE: [svc_tcp.c:358] EOF on
> socket 3
> Sep 10 11:55:02 weather2 10.80.4.14[20338] NOTE: one_svc_run(): RPC layer
> closed connection
> Sep 10 11:55:02 weather2 10.80.4.14[20338] NOTE: Connection to upstream
> LDM closed: pid=19896
> Sep 10 11:55:02 weather2 ldmd[20316] NOTE: child 32754 exited with status
> 6
> Sep 10 11:55:10 weather2 idd.aos.wisc.edu(feed)[824] ERROR: Upstream
> filter prevents data-transfer: 20150910155510.248 TS_ENDT
> {{NEXRAD3|FNEXRAD|FSL5|FSL4|FSL3, ".*"}}
> Sep 10 11:55:10 weather2 idd.aos.wisc.edu(feed)[824] NOTE: Exiting
> Sep 10 11:55:12 weather2 ldmd[831] NOTE: Denying connection from
> "ec2-54-235-144-153.compute-1.amazonaws.com" because not allowed
> Sep 10 11:55:12 weather2 ldmd[831] NOTE: Exiting
> Sep 10 11:55:12 weather2 ldmd[20316] NOTE: child 831 exited with status 1
> Sep 10 11:55:13 weather2 weather3.admin.niu.edu(feed)[30937] NOTE: Exiting
> Sep 10 11:55:13 weather2 ldmd[20316] NOTE: child 30937 exited with status
> 7
> Sep 10 11:55:36 weather2 weather.admin.niu.edu[20341] NOTE: LDM-6 desired
> product-class: 20150910165217.587 TS_ENDT {{LIGHTNING, ".*"},{NONE,
> "SIG=bc72a938e8e777ec7cfe94e86f945e$
> Sep 10 11:55:36 weather2 weather.admin.niu.edu[20341] NOTE: Upstream LDM-6
> on weather.admin.niu.edu is willing to be an alternate feeder
> Sep 10 11:55:46 weather2 ldmd[1666] NOTE: Denying connection from
> "ec2-54-235-144-153.compute-1.amazonaws.com" because not allowed
> Sep 10 11:55:46 weather2 ldmd[1666] NOTE: Exiting
> Sep 10 11:55:46 weather2 ldmd[20316] NOTE: child 1666 exited with status 1
> Sep 10 11:55:59 weather2 pqact[20319] ERROR: Child 1519 exited with status
> 127
> Sep 10 11:56:02 weather2 weather3.admin.niu.edu[20339] NOTE: LDM-6 desired
> product-class: 20150910165243.373 TS_ENDT {{LIGHTNING, ".*"},{NONE,
> "SIG=b1425d8116216a866317aeecd61ac$
> Sep 10 11:56:02 weather2 10.80.4.14[20332] NOTE: LDM-6 desired
> product-class: 20150910165243.373 TS_ENDT {{DIFAX|FNEXRAD|FSL2|UNIWISC,
> ".*"},{NONE, "SIG=d7d31f903b0d733a673132bb$
> Sep 10 11:56:02 weather2 10.80.4.14[20334] NOTE: LDM-6 desired
> product-class: 20150910165243.373 TS_ENDT {{NEXRAD3, ".*"},{NONE,
> "SIG=a9fdbcb13a9b7378ca1227cd02c756eb"}}
> Sep 10 11:56:02 weather2 10.80.4.14[20330] NOTE: LDM-6 desired
> product-class: 20150910165243.373 TS_ENDT {{NIMAGE|WMO, ".*"},{NONE,
> "SIG=64f905e57c950b358127a086388d6eba"}}
> Sep 10 11:56:02 weather2 10.80.4.14[20338] NOTE: LDM-6 desired
> product-class: 20150910165243.374 TS_ENDT {{NEXRAD2,
> "L2.*(KLOT|KIWX|KDVN|KILX|KILN|KMKX|KDMX|KLSX|KMPX|KARX|KGRR)$
> Sep 10 11:56:10 weather2 idd.aos.wisc.edu(feed)[2199] ERROR: Upstream
> filter prevents data-transfer: 20150910155610.366 TS_ENDT
> {{NEXRAD3|FNEXRAD|FSL5|FSL4|FSL3, ".*"}}
> Sep 10 11:56:10 weather2 idd.aos.wisc.edu(feed)[2199] NOTE: Exiting
> Sep 10 11:56:12 weather2 ldmd[2246] NOTE: Denying connection from
> "ec2-54-235-144-153.compute-1.amazonaws.com" because not allowed
> Sep 10 11:56:12 weather2 ldmd[2246] NOTE: Exiting
> Sep 10 11:56:12 weather2 ldmd[20316] NOTE: child 2246 exited with status 1
> Sep 10 11:56:23 weather2 10.80.4.14[20334] WARN: Couldn't connect to LDM
> on 10.80.4.14 using either port 388 or portmapper; : RPC: Remote system
> error - No route to host
> Sep 10 11:56:23 weather2 weather3.admin.niu.edu[20339] WARN: Couldn't
> connect to LDM on weather3.admin.niu.edu using either port 388 or
> portmapper; : RPC: Remote system error - $
> Sep 10 11:56:23 weather2 10.80.4.14[20338] WARN: Couldn't connect to LDM
> on 10.80.4.14 using either port 388 or portmapper; : RPC: Remote system
> error - No route to host
> Sep 10 11:56:39 weather2 10.80.4.14[20332] WARN: Couldn't connect to LDM
> on 10.80.4.14 using either port 388 or portmapper; : RPC: Remote system
> error - No route to host
> Sep 10 11:56:39 weather2 10.80.4.14[20330] WARN: Couldn't connect to LDM
> on 10.80.4.14 using either port 388 or portmapper; : RPC: Remote system
> error - No route to host
> 
> Gilbert
Regards,
Steve Emmerson

Ticket Details
===================
Ticket ID: RCA-822786
Department: Support LDM
Priority: Normal
Status: Closed