[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #TIB-337303]: New IDD relay - ldm is hanging after some time

Pete,

> Here's the backtrace. I'll let it keep running in case you want to check
> anything else.
> 
> top - 17:28:39 up 8 days,  1:05,  6 users,  load average: 1.02, 0.99, 0.65
> Tasks: 359 total,   2 running, 356 sleeping,   1 stopped,   0 zombie
> Cpu(s):  0.0%us,  5.8%sy,  0.0%ni, 94.2%id,  0.0%wa,  0.0%hi,  0.0%si,
> 0.0%st
> Mem:  32874584k total, 17313200k used, 15561384k free,   516472k buffers
> Swap: 32767984k total,        0k used, 32767984k free, 15222300k cached
> 
> PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
> 8472 ldm       20   0 23.0g 944m 942m R 100.0  2.9   1:32.52 ldmd
> 14832 root      20   0 15072 1356  868 S  1.0  0.0  69:57.89 top
> 8544 ldm       20   0 15072 1364  868 R  0.7  0.0   0:38.17 top
> 18466 root      20   0 15072 1360  868 S  0.7  0.0  48:09.22 top
> 1590 root      20   0  9056  512  308 S  0.3  0.0  49:29.26 irqbalance
> 1 root      20   0 19244 1392 1120 S  0.0  0.0   0:02.01 init
> 2 root      20   0     0    0    0 S  0.0  0.0   0:00.01 kthreadd
> 
> [root@idd ldm-6.9.7]# gdb ldmd 8475
> GNU gdb (GDB) Red Hat Enterprise Linux (7.1-29.el6)
> Copyright (C) 2010 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later
> <http://gnu.org/licenses/gpl.html>
> This is free software: you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
> and "show warranty" for details.
> This GDB was configured as "x86_64-redhat-linux-gnu".
> For bug reporting instructions, please see:
> <http://www.gnu.org/software/gdb/bugs/>...
> Reading symbols from /usr/local/ldm/bin/ldmd...done.
> Attaching to program: /usr/local/ldm/bin/ldmd, process 8475
> Reading symbols from /usr/local/ldm/lib/libldm.so.0...done.
> Loaded symbols for /usr/local/ldm/lib/libldm.so.0
> Reading symbols from /usr/local/ldm/lib/libxml2.so.2...done.
> Loaded symbols for /usr/local/ldm/lib/libxml2.so.2
> Reading symbols from /lib64/libdl.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libdl.so.2
> Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
> Loaded symbols for /lib64/libm.so.6
> Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
> Loaded symbols for /lib64/libc.so.6
> Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/ld-linux-x86-64.so.2
> Reading symbols from /lib64/libnss_files.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libnss_files.so.2
> Reading symbols from /lib64/libnss_dns.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libnss_dns.so.2
> Reading symbols from /lib64/libresolv.so.2...(no debugging symbols
> found)...done.
> Loaded symbols for /lib64/libresolv.so.2
> 0x00000033708d4a95 in fcntl () from /lib64/libc.so.6
> Missing separate debuginfos, use: debuginfo-install
> glibc-2.12-1.7.el6_0.5.x86_64
> (gdb) bt
> #0  0x00000033708d4a95 in fcntl () from /lib64/libc.so.6
> #1  0x00007f3aa8011735 in fd_lock (fd=1, cmd=7, l_type=1, offset=0,
> extent=4096, l_whence=0) at pq.c:3115
> #2  0x00007f3aa8011f53 in mm0_ftom (pq=0x1be6250, offset=0, extent=4096,
> rflags=4, ptrp=0x1be6288) at pq.c:3795
> #3  0x00007f3aa800c0a2 in ctl_get (pq=0x1be6250, rflags=4) at pq.c:4379
> #4  0x00007f3aa800f6d5 in pq_insertNoSig (pq=0x1be6250,
> prod=0x7fff1bd97e90) at pq.c:5523
> #5  0x00007f3aa800fb26 in pq_insert (pq=<value optimized out>,
> prod=<value optimized out>) at pq.c:5578
> #6  0x00007f3aa8017543 in dh_saveDataProduct (pq=<value optimized out>,
> info=0x1be8730, data=<value optimized out>, wasHereis=1, notifyAutoShift=1)
> at DownHelp.c:159
> #7  0x00007f3aa801c65d in hereis_6_svc (prod=<value optimized out>,
> rqstp=0x7fff1bd984d0) at ldm6_server.c:661
> #8  0x00007f3aa801acf1 in ldmprog_6 (rqstp=0x7fff1bd984d0,
> transp=0x1cb0870) at ldm6_svc.c:100
> #9  0x00007f3aa802e629 in svc_getreqsock (sock=<value optimized out>) at
> svc.c:543
> #10 0x00007f3aa801ffa2 in one_svc_run (xp_sock=4, inactive_timeo=<value
> optimized out>) at one_svc_run.c:91
> #11 0x00007f3aa8022aca in run_service (upName=0x1caed70
> "idd.unidata.ucar.edu", port=30083184, request=<value optimized out>,
> inactiveTimeout=60,
> pqPathname=0x7fff1bd987a4 "\377\177", pq=<value optimized out>,
> isPrimary=1) at requester6.c:229
> #12 req6_new (upName=0x1caed70 "idd.unidata.ucar.edu", port=30083184,
> request=<value optimized out>, inactiveTimeout=60,
> pqPathname=0x7fff1bd987a4 "\377\177", pq=<value optimized out>,
> isPrimary=1) at requester6.c:672
> #13 0x00007f3aa8014a62 in prog_requester (ldmPort=<value optimized out>)
> at acl.c:1631
> #14 run_requester (ldmPort=<value optimized out>) at acl.c:1809
> #15 new_requester (ldmPort=<value optimized out>) at acl.c:1865
> #16 requester_add (ldmPort=<value optimized out>) at acl.c:1908
> #17 invert_request_acl (ldmPort=<value optimized out>) at acl.c:1974
> #18 0x0000000000405980 in read_conf (conf_path=0x7f3aa82517a0
> "/usr/local/ldm/etc/ldmd.conf", doSomething=1, defaultPort=388) at
> parser.y:593
> #19 0x00000000004065b7 in main (ac=<value optimized out>, av=<value
> optimized out>) at ldmd.c:1049
> (gdb)

And this process was hung using up 100% of the CPU?
Regards,
Steve Emmerson

Ticket Details
===================
Ticket ID: TIB-337303
Department: Support LDM
Priority: Normal
Status: Closed