[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[GEMPAK #DXU-339106]: gempak stopped making images



Leonard,

if "kill pid" doesn't succeed in killing a process, then "kill -9 pid"
should kill the process. 

In your case, the zombie processes may still be trying to either talk to a 
devide driver,
such as "xw", "gf" or "ps", or waiting for a response from the message queue
(the ipcs command will show message queues in use).

I cannot tell you at what point you ran out of resources. If your script is 
unable to
connect to a DISPLAY that it was using, then that would be a problem. 
Otherwise, the use of cntl-C
is bad since it doesn't remove the message queues.

After running "cleanup -c" if message queues still exist, and gplt and devices
still exist, then a reboot is the simplest solution- but you still need to
examine the running plot script to determine if the error condition still 
exists.

Steve Chiswell
Unidata User SUpport




> I tried that but no luck.
> I tried to kill all the gplt prcesses, but they won't stop. The I ran cleanup 
> -c and re-ran the script, but it still had the same error. I used cntrl-C to 
> kill my gempak process.
> 
> wrf@localhost-> ps -ax | grep gplt
> Warning: bad syntax, perhaps a bogus '-'? See /usr/share/doc/procps-3.2.6/FAQ
> 5587 ?        Z      0:00 [gplt] <defunct>
> 8679 ?        Z      0:00 [gplt] <defunct>
> 9675 ?        Z      0:00 [gplt] <defunct>
> 19504 ?        Z      0:00 [gplt] <defunct>
> 25470 ?        Z      0:00 [gplt] <defunct>
> 3158 ?        Z      0:00 [gplt] <defunct>
> 4793 pts/1    S+     0:00 grep gplt
> wrf@localhost-> kill 5587
> wrf@localhost-> ps -ax | grep gplt
> Warning: bad syntax, perhaps a bogus '-'? See /usr/share/doc/procps-3.2.6/FAQ
> 5587 ?        Z      0:00 [gplt] <defunct>
> 8679 ?        Z      0:00 [gplt] <defunct>
> 9675 ?        Z      0:00 [gplt] <defunct>
> 19504 ?        Z      0:00 [gplt] <defunct>
> 25470 ?        Z      0:00 [gplt] <defunct>
> 3158 ?        Z      0:00 [gplt] <defunct>
> 4796 pts/1    S+     0:00 grep gplt
> wrf@localhost->
> 
> 
> wrf@localhost-> script_drvr.csh 
> /home/wrf/wrf/runs/fortuna/wrfpost/gempak/2007070412_wrf_d01.gem
> 
> Begin script_drvr.csh
> 
> Creating process: gplt for queue 786432
> GDATTIM   Grid date/time                    LAST
> GLEVEL    Grid level                        500
> GVCORD    Grid vertical coordinate          PRES
> GFUNC     Scalar grid                       TMPC
> GDFILE    Grid file                         $GEMDATA/HRCBOB.GRD
> CINT      Contour interval/min/max          0
> LINE      Color/type/width/label/smth/fltr  3
> MAP       Map color/dash/width/filter flag  1
> MSCALE    fgc;bgc;mask/units/lat;hide/valu  0
> TITLE     Title color/line/title            1
> DEVICE    Device|name|x size;y size|color   XW
> SATFIL    Satellite image filename(s)
> RADFIL    Radar image filename(s)
> IMCBAR    Color/ornt/anch/x;y/ln;wd/freq
> PROJ      Map projection/angles/margins|dr  MER
> GAREA     Graphics area                     WV
> IJSKIP    Iskp;Istrt;Istp/Jskp;Jstrt;Jstp
> CLEAR     Clear screen flag                 YES
> PANEL     Panel loc/color/dash/width/regn   0
> TEXT      Size/fnt/wdth/brdr/N-rot/just/hw  1
> SCALE     Scalar scale / vector scale       999
> LATLON    Line color/dash/width/freq/inc/l
> HILO      Color/symbol/rng/rad/cnt/intp
> HLSYM     HILO txt size/posn/font/wdth/hw
> CLRBAR    Color/ornt/anch/x;y/ln;wd/freq|t
> CONTUR    Subbox/smooth                     0
> SKIP      Skip_cntr/skip_plt_x;skip_plt_y   0
> FINT      Fill interval/min/max             0
> FLINE     Fill colors/fill types            10-20
> CTYPE     Contour type:  C/F                C
> LUTFIL    Enhancement lookup table filenam
> STNPLT    Txtc/txt attr|marker attr|stnfil
> Parameters requested: GDATTIM,GLEVEL,GVCORD,GFUNC,GDFILE,CINT,LINE,MAP,
> MSCALE,TITLE,DEVICE,SATFIL,RADFIL,IMCBAR,PROJ,GAREA,IJSKIP,CLEAR,PANEL,TEXT,
> SCALE,LATLON,HILO,HLSYM,CLRBAR,CONTUR,SKIP,FINT,FLINE,CTYPE,LUTFIL,STNPLT.
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> 
> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR> GEMPAK-GDCNTR>Creating process: 
> gf for queue 819201
> *** glibc detected *** gdcntr: double free or corruption (out): 
> 0x000000000171aa20 ***
> ======= Backtrace: =========
> /lib64/libc.so.6[0x36fd96d7a3]
> /lib64/libc.so.6(__libc_free+0x84)[0x36fd96d924]
> gdcntr[0x48e62c]
> gdcntr[0x48c37f]
> gdcntr[0x48abba]
> gdcntr[0x479507]
> gdcntr[0x4788a7]
> gdcntr[0x4782f5]
> gdcntr[0x46f043]
> gdcntr[0x42d01a]
> gdcntr[0x42a511]
> gdcntr[0x42a2a4]
> gdcntr[0x436108]
> gdcntr[0x4292f7]
> gdcntr[0x422626]
> gdcntr[0x406f7a]
> gdcntr[0x404387]
> gdcntr[0x4fa9c6]
> /lib64/libc.so.6(__libc_start_main+0xf4)[0x36fd91d084]
> gdcntr[0x403759]
> ======= Memory map: ========
> 00400000-00534000 r-xp 00000000 fd:00 3178607                            
> /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> 00633000-00639000 rw-p 00133000 fd:00 3178607                            
> /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> 00639000-0172b000 rw-p 00639000 00:00 0                                  
> [heap]
> 36fd700000-36fd719000 r-xp 00000000 fd:00 1179877                        
> /lib64/ld-2.4.so
> 36fd819000-36fd81a000 r--p 00019000 fd:00 1179877                        
> /lib64/ld-2.4.so
> 36fd81a000-36fd81b000 rw-p 0001a000 fd:00 1179877                        
> /lib64/ld-2.4.so
> 36fd900000-36fda3f000 r-xp 00000000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fda3f000-36fdb3f000 ---p 0013f000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fdb3f000-36fdb43000 r--p 0013f000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fdb43000-36fdb44000 rw-p 00143000 fd:00 1179878                        
> /lib64/libc-2.4.so
> 36fdb44000-36fdb49000 rw-p 36fdb44000 00:00 0
> 36fdc00000-36fdc80000 r-xp 00000000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 36fdc80000-36fdd80000 ---p 00080000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 36fdd80000-36fdd81000 r--p 00080000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 36fdd81000-36fdd82000 rw-p 00081000 fd:00 1179880                        
> /lib64/libm-2.4.so
> 3703d00000-3703d0d000 r-xp 00000000 fd:00 1179881                        
> /lib64/libgcc_s-4.1.0-20060304.so.1
> 3703d0d000-3703e0d000 ---p 0000d000 fd:00 1179881                        
> /lib64/libgcc_s-4.1.0-20060304.so.1
> 3703e0d000-3703e0e000 rw-p 0000d000 fd:00 1179881                        
> /lib64/libgcc_s-4.1.0-20060304.so.1
> 2afc1ca47000-2afc1ca4b000 rw-p 2afc1ca47000 00:00 0
> 2afc1ca5d000-2afc1ca5e000 rw-p 2afc1ca5d000 00:00 0
> 2afc1ca5e000-2afc1ca7b000 r-xp 00000000 fd:00 8061031                    
> /usr/lib64/libg2c.so.0.0.0
> 2afc1ca7b000-2afc1cb7b000 ---p 0001d000 fd:00 8061031                    
> /usr/lib64/libg2c.so.0.0.0
> 2afc1cb7b000-2afc1cb7c000 rw-p 0001d000 fd:00 8061031                    
> /usr/lib64/libg2c.so.0.0.0
> 2afc1cb7c000-2afc1cb82000 rw-p 2afc1cb7c000 00:00 0
> 2afc1cc00000-2afc1cc21000 rw-p 2afc1cc00000 00:00 0
> 2afc1cc21000-2afc1cd00000 ---p 2afc1cc21000 00:00 0
> 7fffffe77000-7fffffe8e000 rw-p 7fffffe77000 00:00 0                      
> [stack]
> ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0                  
> [vdso]
> IOT Trap
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> -----Original Message-----
> From: Unidata GEMPAK Support [mailto:address@hidden]
> Sent: Tue 7/3/2007 12:31 PM
> To: Leonard H. Montenegro
> Cc: address@hidden
> Subject: [GEMPAK #DXU-339106]: gempak stopped making images
> 
> 
> If you kill a program, or one dies unexpectedly, ensure you haven't
> hung any message queues or left devide drivers and gplt processes running.
> 
> Run the cleanup script to remove message queues and kill gplt
> and device processes, eg: "cleanup -c"
> 
> Steve Chiswell
> Unidata User Support
> 
> > Hello,
> >
> > Our GEMPAK setup has stopped making images and the process needs to be
> > killed.
> >
> > The last few lines of our log files are below.
> >
> > I would appreciate any help in this matter.
> >
> > Cordially,
> >
> > Leonard
> >
> >
> >
> > ...
> >
> > gdcntr[0x404387]
> >
> > gdcntr[0x4fa9c6]
> >
> > /lib64/libc.so.6(__libc_start_main+0xf4)[0x36fd91d084]
> >
> > gdcntr[0x403759]
> >
> > ======= Memory map: ========
> >
> > 00400000-00534000 r-xp 00000000 fd:00 3178607
> > /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> >
> > 00633000-00639000 rw-p 00133000 fd:00 3178607
> > /home/wrf/GEMPAK5.10.1/os/linux64/bin/gdcntr
> >
> > 00639000-0172b000 rw-p 00639000 00:00 0
> > [heap]
> >
> > 36fd700000-36fd719000 r-xp 00000000 fd:00 1179877
> > /lib64/ld-2.4.so
> >
> > 36fd819000-36fd81a000 r--p 00019000 fd:00 1179877
> > /lib64/ld-2.4.so
> >
> > 36fd81a000-36fd81b000 rw-p 0001a000 fd:00 1179877
> > /lib64/ld-2.4.so
> >
> > 36fd900000-36fda3f000 r-xp 00000000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fda3f000-36fdb3f000 ---p 0013f000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fdb3f000-36fdb43000 r--p 0013f000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fdb43000-36fdb44000 rw-p 00143000 fd:00 1179878
> > /lib64/libc-2.4.so
> >
> > 36fdb44000-36fdb49000 rw-p 36fdb44000 00:00 0
> >
> > 36fdc00000-36fdc80000 r-xp 00000000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 36fdc80000-36fdd80000 ---p 00080000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 36fdd80000-36fdd81000 r--p 00080000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 36fdd81000-36fdd82000 rw-p 00081000 fd:00 1179880
> > /lib64/libm-2.4.so
> >
> > 3703d00000-3703d0d000 r-xp 00000000 fd:00 1179881
> > /lib64/libgcc_s-4.1.0-20060304.so.1
> >
> > 3703d0d000-3703e0d000 ---p 0000d000 fd:00 1179881
> > /lib64/libgcc_s-4.1.0-20060304.so.1
> >
> > 3703e0d000-3703e0e000 rw-p 0000d000 fd:00 1179881
> > /lib64/libgcc_s-4.1.0-20060304.so.1
> >
> > 2ba6626c6000-2ba6626ca000 rw-p 2ba6626c6000 00:00 0
> >
> > 2ba6626dc000-2ba6626dd000 rw-p 2ba6626dc000 00:00 0
> >
> > 2ba6626dd000-2ba6626fa000 r-xp 00000000 fd:00 8061031
> > /usr/lib64/libg2c.so.0.0.0
> >
> > 2ba6626fa000-2ba6627fa000 ---p 0001d000 fd:00 8061031
> > /usr/lib64/libg2c.so.0.0.0
> >
> > 2ba6627fa000-2ba6627fb000 rw-p 0001d000 fd:00 8061031
> > /usr/lib64/libg2c.so.0.0.0
> >
> > 2ba6627fb000-2ba662801000 rw-p 2ba6627fb000 00:00 0
> >
> > 2ba662900000-2ba662921000 rw-p 2ba662900000 00:00 0
> >
> > 2ba662921000-2ba662a00000 ---p 2ba662921000 00:00 0
> >
> > 7fffffc32000-7fffffc48000 rw-p 7fffffc32000 00:00 0
> > [stack]
> >
> > ffffffffff600000-ffffffffffe00000 ---p 00000000 00:00 0
> > [vdso]
> >
> > IOT Trap
> >
> > **********************************************************************
> > NOTICE: This e-mail (and any attachments) may contain PRIVILEGED OR 
> > CONFIDENTIAL information and is intended only for the use of the specific 
> > individual(s) to whom it is addressed.  It may contain information that is 
> > privileged and confidential under state and federal law.  This information 
> > may be used or disclosed only in accordance with law, and you may be 
> > subject to penalties under law for improper use or further disclosure of 
> > the information in this e-mail and its attachments. If you have received 
> > this e-mail in error, please immediately notify the person named above by 
> > reply e-mail, and then delete the original e-mail.  Thank you.
> >
> 
> 
> Ticket Details
> ===================
> Ticket ID: DXU-339106
> Department: Support GEMPAK
> Priority: Normal
> Status: Closed
> 
> 
> **********************************************************************
> NOTICE: This e-mail (and any attachments) may contain PRIVILEGED OR 
> CONFIDENTIAL information and is intended only for the use of the specific 
> individual(s) to whom it is addressed.  It may contain information that is 
> privileged and confidential under state and federal law.  This information 
> may be used or disclosed only in accordance with law, and you may be subject 
> to penalties under law for improper use or further disclosure of the 
> information in this e-mail and its attachments. If you have received this 
> e-mail in error, please immediately notify the person named above by reply 
> e-mail, and then delete the original e-mail.  Thank you.
> 


Ticket Details
===================
Ticket ID: DXU-339106
Department: Support GEMPAK
Priority: Normal
Status: Closed