[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: 20000221: Core dumps on sfmod

Steve,

It appears suspect #2 is the problem.  I did a sflist on the particular
daily files I suspected and sure enough the came up with segfaults in the
middle of them.  I've added the -n option to dchrly and will track the
progress.  Thanks much for your help.

Regards,

Chris

On Tue, 22 Feb 2000, Unidata Support wrote:

> 
> Chris,
> 
> Two possible problems with your approach would be:
> 1) The input file is currently being written into by the decoder
>    when your script is run. This would be common if you saw
>    errors like "FL -168".
> 
> 2) The daily file is more likely to get corrupted if you are storing
>    the raw reports in the decoded file, and a bad report caused the
>    stored string to exceed the amount of space allowed.
> 
>    The case above would be the same as if you tried to use sflist on the
>    file with dattim=all and area=dset. So, if your sfmod script dies, do you
>    find that the original input file is corrupted?
> 
> The upperair file is less likely to encounter the above two probles since
> there is much less data (fewer stations), so that the likelihood of the
> file being open and written to in 1) is much less; and the raw reports
> are not stored in upper air files as in 2) above. You can run dchrly with the
> -n flag not to store the raw reports if you find that they are problematic.
> This is not a big problem that I have found, but ocassionally, I do fine
> a bulleting that somehow has no line feeds for a couple of dozen metars,
> so dchrly tries to store it all as one report.
> 
> As I mentioned, you can determine if your surface file was corrupt by 
> trying to list the entire contents of the file using sflist. If that
> fails, then that is likely why sfmod died as well. If it suceeds, then
> it is more likely that the file was being updated or written to.
> 
> Steve Chiswell
> Unidata User Support
> 
> 
> 
> 
> 
> >From: "C. Vandersip" <address@hidden>
> >Organization: .
> >Keywords: 200002211338.GAA21659
> 
> >  This message is in MIME format.  The first part should be readable text,
> >  while the remaining parts are likely unreadable without MIME-aware tools.
> >  Send mail to address@hidden for more info.
> >
> >---559023410-959030623-951140265=:24523
> >Content-Type: TEXT/PLAIN; charset=US-ASCII
> >
> >Hi Steve,
> >
> >I'm running a script that uses sfmod and snmod to take in data from the
> >gempak sfc and upa files created by dchrly and creates gempak files called
> >"cur.gem" to house data for the last 5 days.  It does this each night to
> >rotate the file and keep it current.
> >
> >My problem is that when this script runs, sfmod very often encounters
> >problems with the daily sfc files and either dumps core (segmentation
> >fault) or, more recently, the process hangs w/out seg faulting.  There
> >have been no problems with the snmod portion, only sfmod.  Could sfmod be
> >encountering corruption in the daily sfc files that cause it to die or
> >hang, or is there a problem in my script syntax?  A copy of the
> >script is attached.  Any help you can provide is appreciated.  
> >
> >Regards,
> >
> >Chris
> >
> >      ###############################################################
> >      #                      Chris Vandersip                        #
> >      #        Computer Research Specialist/Dept. Sysadmin          #
> >      #  Rm. 024, Dept. of Meteorology, Florida State University    #
> >      #          address@hidden   (850)644-2522                     #
> >      ###############################################################
> >
> >---559023410-959030623-951140265=:24523
> >Content-Type: TEXT/PLAIN; charset=US-ASCII; name="rotate_cur.gem"
> >Content-Transfer-Encoding: BASE64
> >Content-ID: <address@hidden>
> >Content-Description: 
> >Content-Disposition: attachment; filename="rotate_cur.gem"
> >
> >IyEvYmluL2NzaCAtZg0KIw0KIwlyb3RhdGVfY3VyLmdlbSAtIE1haW50YWlu
> >cyBnZW1wYWsgc3VyZmFjZSBhbmQgdXBwZXJhaXIgZmlsZXMNCiMJCSAgICAg
> >ICAgICgkR0VNU0ZDL2N1ci5nZW0gYW5kICRHRU1VUEEvY3VyLmdlbSkgY29u
> >dGFpbmluZw0KIwkJICAgCSBkYXRhIGZvciB0aGUgcGFzdCA1IGRheXMuIFRo
> >aXMgc2NyaXB0IHJvdGF0ZXMgb2xkIGRhdGEgb3V0Lg0KIw0KIwlNb2RpZmlj
> >YXRpb25zOg0KIw0KIwkgCUphbiAxNCwgMTk5MglPcmlnaW5hbCBzY3JpcHQJ
> >CQlKZWZmIFdhcmQvRlNVDQojCQlPY3QuICAgIDE5OTQgICAgTW9kaWZpZWQg
> >Zm9yIGdlbXBhayA1LjIgICAgICAgICBULiBLaXR0ZXJtYW4NCiMgICAgICAg
> >ICAgICAgICBGZWIuICAgIDE5OTUgICAgTW9kaWZpZWQgZm9yIHByb3BlciBj
> >eWNsaW5nIG9mDQojICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNp
> >cmN1bGFyIGZpbGUgYnkgYSBjYXN0IG9mIHRob3VzYW5kcy4uLg0KIw0KIyAg
> >ICAgICAgICAgICAgIE5vdi4gICAgMTk5NSAgICBGaXhlZCBzbyB0aGUgZGFy
> >biB0aGluZyB3b3VsZCB3b3JrIQ0KIwkgICAgICAgICAgICAgICAgICAgICAg
> >ICAtQW5kcmV3IERldmFuYXMgJiBKb24gUml6em8NCiMJICAgICAgICBKYW4u
> >ICAgIDIwMDAgICAgT3ZlcmhhdWxlZCBjb21wbGV0ZWx5IHRvIGNvbWJpbmUg
> >c2ZjLiBhbmQNCiMJCQkJdXBhLiBzY3JpcHRzIGFuZCByZWFsbHkgZ2V0IGl0
> >IHRvIHdvcmsuDQojCQkJCS1DaHJpcyBWYW5kZXJzaXANCiMgU2V0IHVwIHRo
> >ZSBlbnZpcm9ubWVudA0KIw0Kc291cmNlIC9uYXdpcHMvR2VtZW52aXJvbg0K
> >c2V0ZW52IFNGU1ROUyAvbmF3aXBzL2dlbXBhazUuNC90YWJsZXMvc3Rucy9z
> >Zm1ldGFyX3NhLnRibA0Kc2V0ZW52IFNOU1ROUyAvbmF3aXBzL2dlbXBhazUu
> >NC90YWJsZXMvc3Rucy9zbndvcmxkLnRibA0Kc2V0ZW52IFNGUEFDSyAvbmF3
> >aXBzL2dlbXBhazUuNC90YWJsZXMvcGFjay9ocmx5LnBhY2sNCnNldGVudiBT
> >TlBBQ0sgL25hd2lwcy9nZW1wYWs1LjQvdGFibGVzL3BhY2svc25tZXJnLnBh
> >Y2sNCiMNCnNldCBwYXRoID0gKC9iaW4gL3Vzci9iaW4gL3Vzci9sb2NhbC9i
> >aW4gL3Vzci9vcGVud2luL2JpbiAvbmF3aXBzL2JpbiAuIC91c3IvbG9jYWwv
> >bGRtL2JpbikNCiMNCiMgUm90YXRlIGRhdGUgZmlsZXMNCiMNCmNkIC9uYXdp
> >cHMvRlNVL2N1cmdlbV9yb3RhdGUNCiMNCmVjaG8gIkNoZWNraW5nIGZvciBE
> >YXRlIENoYW5nZSINCnNldCBub3dkYXRlPWBkYXRlIC11ICsleSVtJWRgDQpz
> >ZXQgcHJldmRhdGU9YGNhdCAuL2RheXN0YXJ0LmRhdGVgDQppZiAoJG5vd2Rh
> >dGUgIT0gJHByZXZkYXRlKSB0aGVuDQogICBlY2hvICJEYXRlIENoYW5nZTog
> >Um90YXRpbmcgZGF0ZSBmaWxlcyINCiAgIGVjaG8NCiAgIHJtIC1mIGRheXN0
> >YXJ0LTYuZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtNS5kYXRlIGRheXN0YXJ0
> >LTYuZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtNC5kYXRlIGRheXN0YXJ0LTUu
> >ZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtMy5kYXRlIGRheXN0YXJ0LTQuZGF0
> >ZQ0KICAgbXYgLWYgZGF5c3RhcnQtMi5kYXRlIGRheXN0YXJ0LTMuZGF0ZQ0K
> >ICAgbXYgLWYgZGF5c3RhcnQtMS5kYXRlIGRheXN0YXJ0LTIuZGF0ZQ0KICAg
> >bXYgLWYgZGF5c3RhcnQuZGF0ZSBkYXlzdGFydC0xLmRhdGUNCiAgIGVjaG8g
> >JG5vd2RhdGUgPiBkYXlzdGFydC5kYXRlDQplbmRpZg0KIyBTZXQgZGF0ZSB2
> >YXJpYWJsZXMgd2l0aCBjZW50dXJ5IGluY2x1ZGVkDQpzZXQgZGF5c3RhcnQ9
> >YGNhdCAuL2RheXN0YXJ0LmRhdGVgDQpzZXQgZGF5c3RhcnQxPWBjYXQgLi9k
> >YXlzdGFydC0xLmRhdGVgDQpzZXQgZGF5c3RhcnQyPWBjYXQgLi9kYXlzdGFy
> >dC0yLmRhdGVgDQpzZXQgZGF5c3RhcnQzPWBjYXQgLi9kYXlzdGFydC0zLmRh
> >dGVgDQpzZXQgZGF5c3RhcnQ0PWBjYXQgLi9kYXlzdGFydC00LmRhdGVgDQpz
> >ZXQgZGF5c3RhcnQ1PWBjYXQgLi9kYXlzdGFydC01LmRhdGVgDQpzZXQgZGF5
> >c3RhcnQ2PWBjYXQgLi9kYXlzdGFydC02LmRhdGVgDQojDQplY2hvICJEb25l
> >Ig0KZWNobyAiS2VlcGluZyBEYXRlczoiDQplY2hvICRkYXlzdGFydA0KZWNo
> >byAkZGF5c3RhcnQxDQplY2hvICRkYXlzdGFydDINCmVjaG8gJGRheXN0YXJ0
> >Mw0KZWNobyAkZGF5c3RhcnQ0DQplY2hvICRkYXlzdGFydDUNCmVjaG8gJGRh
> >eXN0YXJ0Ng0KZWNobw0KIw0KIyBTVVJGQUNFIFNFQ1RJT04NCiMgLS0tLS0t
> >LS0tLS0tLS0tDQojDQojICBDcmVhdGUgYSBuZXcgc3VyZmFjZSBmaWxlLiAg
> >UmVtb3ZpbmcgdGltZXMgZnJvbSBvbGQgDQojICBzdXJmYWNlIGZpbGUgZG9l
> >cyBub3QgcmVtb3ZlIGRhdGEsIHNvIHRoZSBmaWxlIGp1c3QNCiMgIGtlZXBz
> >IGdldHRpbmcgYmlnZ2VyLg0KIw0KZWNobyAiU3RhcnRpbmcgU3VyZmFjZSBT
> >ZWN0aW9uIg0KZWNobw0KZWNobyAiTW92aW5nIGN1ci5nZW0gdG8gdG1wIGZp
> >bGUiDQptdiAkR0VNU0ZDL2N1ci5nZW0gJEdFTVNGQy90bXAuZ2VtDQplY2hv
> >ICJEb25lIg0KZWNobyAiQ3JlYXRpbmcgbmV3IGN1ci5nZW0gZmlsZSINCiRH
> >RU1FWEUvc2ZjZmlsID4gc2ZjZmlsLmxvZyA8PCBlbmRzZmNmaWwNCnNmb3V0
> >Zj0iL2V4cG9ydC9kYXRhL2dlbXBhay9zdXJmYWNlL3Nhby9jdXIuZ2VtIg0K
> >c2Zwcm1mPSIkU0ZQQUNLIg0Kc3RuZmlsPSIkU0ZTVE5TIg0Kc2hpcGZsPSJO
> >TyINCnRpbXN0bj0iMjAwLzMwMDAiDQpydW4NCmV4aXQNCmVuZHNmY2ZpbA0K
> >ZWNobyAiRG9uZSINCiMNCiMgIFJ1biBzZm1vZCB0byBtZXJnZSBkZXNpcmVk
> >IGRhdGEgaW50byBjdXIuZ2VtDQojDQplY2hvICJNZXJnaW5nIGRhdGEgaW50
> >byBuZXcgY3VyLmdlbSBmaWxlIg0KJEdFTUVYRS9zZm1vZCA+IHNmbW9kNC5s
> >b2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1ubw0Kc2ZmaWxlPSIkR0VNU0ZD
> >LzIwJGRheXN0YXJ0NC5nZW0iDQpzZm91dGY9IiRHRU1TRkMvY3VyLmdlbSIN
> >CmRhdHRpbT0iJGRheXN0YXJ0NC9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVu
> >DQpleGl0DQplbmRzZm1vZA0KZWNobyAiRGF5IDUgZG9uZSINCiRHRU1FWEUv
> >c2Ztb2QgPiBzZm1vZDMubG9nIDw8IGVuZHNmbW9kDQpcJHJlc3BvbmQ9bm8N
> >CnNmZmlsZT0iJEdFTVNGQy8yMCRkYXlzdGFydDMuZ2VtIg0Kc2ZvdXRmPSIk
> >R0VNU0ZDL2N1ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDMvYWxsIg0KYXJl
> >YT0iZHNldCINCmwNCnJ1bg0KZXhpdA0KZW5kc2Ztb2QNCmVjaG8gIkRheSA0
> >IGRvbmUiDQokR0VNRVhFL3NmbW9kID4gc2Ztb2QyLmxvZyA8PCBlbmRzZm1v
> >ZA0KXCRyZXNwb25kPW5vDQpzZmZpbGU9IiRHRU1TRkMvMjAkZGF5c3RhcnQy
> >LmdlbSINCnNmb3V0Zj0iJEdFTVNGQy9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5
> >c3RhcnQyL2FsbCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNm
> >bW9kDQplY2hvICJEYXkgMyBkb25lIg0KJEdFTUVYRS9zZm1vZCA+IHNmbW9k
> >MS5sb2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1ubw0Kc2ZmaWxlPSIkR0VN
> >U0ZDLzIwJGRheXN0YXJ0MS5nZW0iDQpzZm91dGY9IiRHRU1TRkMvY3VyLmdl
> >bSINCmRhdHRpbT0iJGRheXN0YXJ0MS9hbGwiDQphcmVhPSJkc2V0Ig0KbA0K
> >cnVuDQpleGl0DQplbmRzZm1vZA0KZWNobyAiRGF5IDIgZG9uZSINCiRHRU1F
> >WEUvc2Ztb2QgPiBzZm1vZC5sb2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1u
> >bw0Kc2ZmaWxlPSIkR0VNU0ZDLzIwJGRheXN0YXJ0LmdlbSINCnNmb3V0Zj0i
> >JEdFTVNGQy9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQvYWxsIg0KYXJl
> >YT0iZHNldCINCmwNCnJ1bg0KZXhpdA0KZW5kc2Ztb2QNCiMNCmVjaG8gIkRh
> >eSAxIGRvbmUiDQojDQojIFJlbW92ZSB0ZW1wb3JhcnkgZmlsZQ0KIw0KZWNo
> >byAiUmVtb3ZpbmcgdG1wLmdlbSBmaWxlIg0Kcm0gL2V4cG9ydC9kYXRhL2dl
> >bXBhay9zdXJmYWNlL3Nhby90bXAuZ2VtDQplY2hvICJEb25lIg0KIw0KIyBV
> >UFBFUkFJUiBTRUNUSU9ODQojIC0tLS0tLS0tLS0tLS0tLS0NCiMNCiMgIENy
> >ZWF0ZSBhIG5ldyB1cHBlcmFpciBmaWxlLiAgUmVtb3ZpbmcgdGltZXMgZnJv
> >bSBvbGQNCiMgIHN1cmZhY2UgZmlsZSBkb2VzIG5vdCByZW1vdmUgZGF0YSwg
> >c28gdGhlIGZpbGUganVzdA0KIyAga2VlcHMgZ2V0dGluZyBiaWdnZXIuDQoj
> >DQplY2hvICJTdGFydGluZyBVcHBlcmFpciBzZWN0aW9uIg0KZWNobyAiTW92
> >aW5nIGN1ci5nZW0gdG8gdG1wLmdlbSINCm12ICRHRU1VUEEvY3VyLmdlbSAk
> >R0VNVVBBL3RtcC5nZW0NCmVjaG8gIkRvbmUiDQplY2hvDQplY2hvICJDcmVh
> >dGluZyBuZXcgY3VyLmdlbSBmaWxlIg0KJEdFTUVYRS9zbmNmaWwgPiBzbmNm
> >aWwubG9nIDw8IGVuZHNuY2ZpbA0Kc25vdXRmPSIvZXhwb3J0L2RhdGEvZ2Vt
> >cGFrL3VwcGVyYWlyL2N1ci5nZW0iDQpzbnBybWY9IiRTTlBBQ0siDQpzdG5m
> >aWw9IiRTTlNUTlMiDQpzaGlwZmw9Ik5PIg0KdGltc3RuPSI5OS8xMCINCnJ1
> >bg0KZXhpdA0KZW5kc25jZmlsDQplY2hvICJEb25lIg0KIw0KIyAgUnVuIHNu
> >bW9kIHRvIG1lcmdlIGRlc2lyZWQgZGF0YSBpbnRvIGN1ci5nZW0NCiMNCmVj
> >aG8gIk1lcmdpbmcgZGF0YSBpbnRvIG5ldyBjdXIuZ2VtIGZpbGUiDQokR0VN
> >RVhFL3NubW9kID4gc25tb2Q2LmxvZyA8PCBlbmRzbm1vZA0KXCRyZXNwb25k
> >PW5vDQpzbmZpbGU9IiRHRU1VUEEvMjAkZGF5c3RhcnQ2LmdlbSINCnNub3V0
> >Zj0iJEdFTVVQQS9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQ2L2FsbCIN
> >CmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hvICJE
> >YXkgNyBkb25lIg0KJEdFTUVYRS9zbm1vZCA+IHNubW9kNS5sb2cgPDwgZW5k
> >c25tb2QNClwkcmVzcG9uZD1ubw0Kc25maWxlPSIkR0VNVVBBLzIwJGRheXN0
> >YXJ0NS5nZW0iDQpzbm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRpbT0i
> >JGRheXN0YXJ0NS9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVuDQpleGl0DQpl
> >bmRzbm1vZA0KZWNobyAiRGF5IDYgZG9uZSINCiRHRU1FWEUvc25tb2QgPiBz
> >bm1vZDQubG9nIDw8IGVuZHNubW9kDQpcJHJlc3BvbmQ9bm8NCnNuZmlsZT0i
> >JEdFTVVQQS8yMCRkYXlzdGFydDQuZ2VtIg0Kc25vdXRmPSIkR0VNVVBBL2N1
> >ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDQvYWxsIg0KYXJlYT0iZHNldCIN
> >CmwNCnJ1bg0KZXhpdA0KZW5kc25tb2QNCmVjaG8gIkRheSA1IGRvbmUiDQok
> >R0VNRVhFL3NubW9kID4gc25tb2QzLmxvZyA8PCBlbmRzbm1vZA0KXCRyZXNw
> >b25kPW5vDQpzbmZpbGU9IiRHRU1VUEEvMjAkZGF5c3RhcnQzLmdlbSINCnNu
> >b3V0Zj0iJEdFTVVQQS9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQzL2Fs
> >bCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hv
> >ICJEYXkgNCBkb25lIg0KJEdFTUVYRS9zbm1vZCA+IHNubW9kMi5sb2cgPDwg
> >ZW5kc25tb2QNClwkcmVzcG9uZD1ubw0Kc25maWxlPSIkR0VNVVBBLzIwJGRh
> >eXN0YXJ0Mi5nZW0iDQpzbm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRp
> >bT0iJGRheXN0YXJ0Mi9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVuDQpleGl0
> >DQplbmRzbm1vZA0KZWNobyAiRGF5IDMgZG9uZSINCiRHRU1FWEUvc25tb2Qg
> >PiBzbm1vZDEubG9nIDw8IGVuZHNubW9kDQpcJHJlc3BvbmQ9bm8NCnNuZmls
> >ZT0iJEdFTVVQQS8yMCRkYXlzdGFydDEuZ2VtIg0Kc25vdXRmPSIkR0VNVVBB
> >L2N1ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDEvYWxsIg0KYXJlYT0iZHNl
> >dCINCmwNCnJ1bg0KZXhpdA0KZW5kc25tb2QNCmVjaG8gIkRheSAyIGRvbmUi
> >DQokR0VNRVhFL3NubW9kID4gc25tb2QubG9nIDw8IGVuZHNubW9kDQpcJHJl
> >c3BvbmQ9bm8NCnNuZmlsZT0iJEdFTVVQQS8yMCRkYXlzdGFydC5nZW0iDQpz
> >bm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRpbT0iJGRheXN0YXJ0L2Fs
> >bCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hv
> >ICJEYXkgMSBkb25lIg0KIw0KIw0KIyBSZW1vdmUgdGVtcG9yYXJ5IGZpbGUg
> >YW5kIHJlc3RhcnQgTERNDQojDQplY2hvICJSZW1vdmluZyB0bXAuZ2VtIGZp
> >bGUiDQpybSAvZXhwb3J0L2RhdGEvZ2VtcGFrL3VwcGVyYWlyL3RtcC5nZW0N
> >CmVjaG8gIkRvbmUiDQpleGl0DQo=
> >---559023410-959030623-951140265=:24523--
> >
> 
> **************************************************************************** <
> Unidata User Support                                    UCAR Unidata Program <
> (303)497-8644                                                  P.O. Box 3000 <
> address@hidden                                   Boulder, CO 80307 <
> ---------------------------------------------------------------------------- <
> Unidata WWW Service                        http://www.unidata.ucar.edu/      <
> **************************************************************************** <
> 

         ###############################################################
         #                      Chris Vandersip                        #
         #        Computer Research Specialist/Dept. Sysadmin          #
         #  Rm. 024, Dept. of Meteorology, Florida State University    #
         #          address@hidden   (850)644-2522                     #
         ###############################################################