Hello everyone,
I guess this is a good a time as any to announce that after 7 or 8 years,
weather, weather2, and weather3.admin.niu.edu have just all been replaced,
in a span of one week! We hope this provides service improvement to our
downstream customers. But I am having a vexing issue, and even Steve
Emmerson is at a loss to explain it. So, I am going to throw it out to the
group.
At least once a day, and only on weather3.admin.niu.edu, the LDM crashes
and dumps core. The queue does not become corrupt, so an "ldmadmin
restart" gets it going again. The servers should be pretty much identical,
but that doesn't mean that there aren't nuances, or I forgot to install
something. In any case, LDM 6.12.14 compiles on weather3 without any
unusual warning or error messages.
But then it crashes, and here is the stack trace from one of the core
files:
GNU gdb (GDB) Red Hat Enterprise Linux (7.2-83.el6)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later
<http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /home/ldm/ldm-6.12.14/bin/pqact...done.
[New Thread 21807]
Missing separate debuginfo for /home/ldm/ldm-6.12.14/lib/libldm.so.0
Try: yum --enablerepo='*-debug*' install
/usr/lib/debug/.build-id/93/c0f43435b6a6ad9b1cc6a0356f52591f534678
Missing separate debuginfo for
Try: yum --enablerepo='*-debug*' install
/usr/lib/debug/.build-id/77/385010026236dada9bfeadc4717b7518e8bb29
Reading symbols from /home/ldm/ldm-6.12.14/lib/libldm.so.0...done.
Loaded symbols for /home/ldm/ldm-6.12.14/lib/libldm.so.0
Reading symbols from /usr/lib64/libgdbm.so.2...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib64/libgdbm.so.2
Reading symbols from /usr/lib64/libxml2.so.2...(no debugging symbols
found)...done.
Loaded symbols for /usr/lib64/libxml2.so.2
Reading symbols from /lib64/libz.so.1...(no debugging symbols
found)...done.
Loaded symbols for /lib64/libz.so.1
Reading symbols from /lib64/libpthread.so.0...(no debugging symbols
found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib64/libpthread.so.0
Reading symbols from /lib64/libm.so.6...(no debugging symbols
found)...done.
Loaded symbols for /lib64/libm.so.6
Reading symbols from /lib64/libc.so.6...(no debugging symbols
found)...done.
Loaded symbols for /lib64/libc.so.6
Reading symbols from /lib64/libdl.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib64/libdl.so.2
Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols
found)...done.
Loaded symbols for /lib64/ld-linux-x86-64.so.2
Core was generated by `/home/ldm/bin/pqact -f WMO
/home/ldm/etc/pqact.conf'.
Program terminated with signal 11, Segmentation fault.
#0 0x00000032c58c520b in update_cur_sifted_state () from /lib64/libc.so.6
Missing separate debuginfos, use: debuginfo-install
gdbm-1.8.0-38.el6.x86_64 glibc-2.12-1.166.el6_7.1.x86_64
libxml2-2.7.6-20.el6.x86_64 zlib-1.2.3-29.el6.x86_64
(gdb) where
#0 0x00000032c58c520b in update_cur_sifted_state () from /lib64/libc.so.6
#1 0x00000032c58c5b63 in sift_states_backward () from /lib64/libc.so.6
#2 0x00000032c58c824a in re_search_internal () from /lib64/libc.so.6
#3 0x00000032c58c95c3 in regexec@@GLIBC_2.3.4 () from /lib64/libc.so.6
#4 0x00000000004069f6 in processProduct (infop=<value optimized out>,
datap=0x7fdacdca4570, xprod=0x7fdacdca44f8, xlen=768,
otherargs=0x7ffe686e7acf) at palt.c:1274
#5 0x00007fdbd3ad449f in pq_sequence (pq=0x12aeab0, mt=TV_GT,
clss=0x7ffe686e7a70, ifMatch=0x406950 <processProduct>,
otherargs=0x7ffe686e7acf) at pq.c:7540
#6 0x0000000000408344 in main (ac=<value optimized out>,
av=<value optimized out>) at pqact.c:674
Does anyone have an idea of what I am doing wrong? Is there a package or
something that I forgot to install?
Gilbert
*******************************************************************************
Gilbert Sebenste ********
(My opinions only!) ******
Staff Meteorologist, Northern Illinois University ****
E-mail: sebenste@xxxxxxxxxxxxxxxxxxxxx ***
web: http://weather.admin.niu.edu **
Twitter: http://www.twitter.com/NIU_Weather **
Facebook: http://www.facebook.com/niu.weather *
*******************************************************************************
