Re: [gembud] gembud Digest, Vol 66, Issue 3

Mike,

Great question.  I probably should I have asked the same question, but ended up 
working with synoptic files on the NWS
TGFTP ftp server, for example:  
ftp://tgftp.nws.noaa.gov/SL.us008001/DF.an/DC.sflnd/DS.synop/sn.0140.txt

I found that the GEMPAK decoder will decode the NWS TGFTP synoptic file if I 
insert special non-printing ASCII control
characters the decoder is looking for in the NOAAPORT file but missing from the 
NWS TGFTP file:
at the beginning:
     ctrl-v ctrl-a ctrl-v ctrl-m ctrl-v ctrl-m
     nnn
where nnn is the Transmission sequence number. It is a three-digit group giving 
the transmission sequence of messages
from one centre over a particular channel to the receiving centre on that 
channel. Numbers 000 to 999
inclusive must be used in a cyclic manner. (When International Alphabet No. 5 
is used, the group nnn
may be a fixed combination of three characters, if agreed between the centres 
concerned.)
at the end:
     ctrl-c
Those are the key sequences to generate these special charaters in the vi 
editor, which appear as follows in vi:
     ^C^A^M^M
I found it works either at the beginning/end of the entire file, or each 
individual report in the file.
Reports in the file come delineated by the hash-padded time stamp, eg 
"####018000127####".
Replace these with the special characters.

 Reference: 
http://www.wmo.int/pages/prog/www/WIS/Publications/WMO_386/WMO_386_Vol_I_en.pdf

Here are my actual script instructions relating to the above notes:

#First add a ^A^M^M to the top of the file and a ^C to the end of the file
sed -i '1s/####.*/\x01\x0D\x0D\n000/' $fn

#Replace every delinieator with a nnn number sequence
sed -i 's/####.*/\x0D\x0D\n\x03\x01\x0D\x0D\n000/g' $fn

#Add a ^C to the end of the file
sed -i '$a\\x03' $fn

Hope that helps.

Regards,
Craig

On 7/25/2014 2:00 PM, gembud-request@xxxxxxxxxxxxxxxx wrote:
> Send gembud mailing list submissions to
>       gembud@xxxxxxxxxxxxxxxx
>
> To subscribe or unsubscribe via the World Wide Web, visit
>       http://mailman.unidata.ucar.edu/mailman/listinfo/gembud
> or, via email, send a message with subject or body 'help' to
>       gembud-request@xxxxxxxxxxxxxxxx
>
> You can reach the person managing the list at
>       gembud-owner@xxxxxxxxxxxxxxxx
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of gembud digest..."
>
>
> Today's Topics:
>
>    1. Synoptic Data source (Mike Hardiman - NWS Federal)
>    2. Re: Synoptic Data source (Robert Mullenax)
>    3. Re: Synoptic Data source (Kwan-Yin Kong - NOAA Federal)
>    4. NMap2 on Ubuntu (Pettee, Warren)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Fri, 25 Jul 2014 02:34:03 -0600
> From: Mike Hardiman - NWS Federal <mike.hardiman@xxxxxxxx>
> To: gembud@xxxxxxxxxxxxxxxx
> Subject: [gembud] Synoptic Data source
> Message-ID:
>       <CAFbcWUtQ7=oPGdWjJw6Tr=LHdfojEZOq4WdAQmfNdLWFk0wyvg@xxxxxxxxxxxxxx>
> Content-Type: text/plain; charset="utf-8"
>
> Hi,
>
> I'm looking for a good source for synoptic surface data.  I've been trying
> to use the files available at http://weather.admin.niu.edu/data/, but I
> keep getting errors with dclsfc:
>
> [8515] 140725/0228[LS -3]  Bad group length - reject rest of report: 521
> SMMX01  MXBA    250600
> [8515] 140725/0228[LS 1]  76117 06/// /1703 10273 20188 38897 40014 51021
> 60002 7//// 8//// 90550 333 0//// 10361 20229 30/// 4//// 50
> [8515] 140725/0228[SF -10]  Station 76117 is not in file.
> [8515] 140725/0228[LS -3]  Bad group length - reject rest of report: 521
> SMMX01  MXBA    250600
> [8515] 140725/0228[LS 1]  76161 06/// /1602 10332 20200 39875 40112 52015
> 60002 7//// 8//// 90550 333 0//// 10440 20303 30/// 4//// 50
> [8515] 140725/0228[SF -10]  Station 76161 is not in file.
>
> Something that is in a format that's ready to be pushed through dclsfc
> would be great... or already in gempak format would be even better!
>
> Thanks,
> -Mike
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: 
> <http://mailman.unidata.ucar.edu/mailing_lists/archives/gembud/attachments/20140725/36d8ee8e/attachment.html>
>
> ------------------------------
>
> Message: 2
> Date: Fri, 25 Jul 2014 08:46:59 +0000
> From: Robert Mullenax <Robert.Mullenax@xxxxxxxxxxxxx>
> To: Mike Hardiman - NWS Federal <mike.hardiman@xxxxxxxx>,
>       "gembud@xxxxxxxxxxxxxxxx" <gembud@xxxxxxxxxxxxxxxx>
> Subject: Re: [gembud] Synoptic Data source
> Message-ID:
>       <DD3E9362ABFA2F4DAF1467D585193D11019C50@xxxxxxxxxxxxxxxxxxx>
> Content-Type: text/plain; charset="us-ascii"
>
> Mike,
>
> Unidata has it already decoded on motherlode:
>
> http://motherlode.ucar.edu/decoded/gempak/syn/
>
> Regards,
> Robert Mullenax
> CSBF Meteorology
>
> ________________________________________
> From: gembud-bounces@xxxxxxxxxxxxxxxx [gembud-bounces@xxxxxxxxxxxxxxxx] on 
> behalf of Mike Hardiman - NWS Federal [mike.hardiman@xxxxxxxx]
> Sent: Friday, July 25, 2014 3:34 AM
> To: gembud@xxxxxxxxxxxxxxxx
> Subject: [gembud] Synoptic Data source
>
> Hi,
>
> I'm looking for a good source for synoptic surface data.  I've been trying to 
> use the files available at http://weather.admin.niu.edu/data/, but I keep 
> getting errors with dclsfc:
>
> [8515] 140725/0228[LS -3]  Bad group length - reject rest of report: 521 
> SMMX01  MXBA    250600
> [8515] 140725/0228[LS 1]  76117 06/// /1703 10273 20188 38897 40014 51021 
> 60002 7//// 8//// 90550 333 0//// 10361 20229 30/// 4//// 50
> [8515] 140725/0228[SF -10]  Station 76117 is not in file.
> [8515] 140725/0228[LS -3]  Bad group length - reject rest of report: 521 
> SMMX01  MXBA    250600
> [8515] 140725/0228[LS 1]  76161 06/// /1602 10332 20200 39875 40112 52015 
> 60002 7//// 8//// 90550 333 0//// 10440 20303 30/// 4//// 50
> [8515] 140725/0228[SF -10]  Station 76161 is not in file.
>
> Something that is in a format that's ready to be pushed through dclsfc would 
> be great... or already in gempak format would be even better!
>
> Thanks,
> -Mike
>
>
>
> ------------------------------
>
> Message: 3
> Date: Fri, 25 Jul 2014 05:21:34 -0400
> From: Kwan-Yin Kong - NOAA Federal <kwan-yin.kong@xxxxxxxx>
> To: Mike Hardiman - NWS Federal <mike.hardiman@xxxxxxxx>
> Cc: "gembud@xxxxxxxxxxxxxxxx" <gembud@xxxxxxxxxxxxxxxx>
> Subject: Re: [gembud] Synoptic Data source
> Message-ID:
>       <CADABNV0Rq11VKQ9CU93bO15C7j4NLHNqQ6FQ=YY3dAP933e4JA@xxxxxxxxxxxxxx>
> Content-Type: text/plain; charset="utf-8"
>
> Hi Mike,
>
> Try Iowa State's GEMPAK archives.  Hope that helps.
>
> Kwan
>
>
> On Fri, Jul 25, 2014 at 4:34 AM, Mike Hardiman - NWS Federal <
> mike.hardiman@xxxxxxxx> wrote:
>
>> Hi,
>>
>> I'm looking for a good source for synoptic surface data.  I've been trying
>> to use the files available at http://weather.admin.niu.edu/data/, but I
>> keep getting errors with dclsfc:
>>
>> [8515] 140725/0228[LS -3]  Bad group length - reject rest of report: 521
>> SMMX01  MXBA    250600
>> [8515] 140725/0228[LS 1]  76117 06/// /1703 10273 20188 38897 40014 51021
>> 60002 7//// 8//// 90550 333 0//// 10361 20229 30/// 4//// 50
>> [8515] 140725/0228[SF -10]  Station 76117 is not in file.
>> [8515] 140725/0228[LS -3]  Bad group length - reject rest of report: 521
>> SMMX01  MXBA    250600
>> [8515] 140725/0228[LS 1]  76161 06/// /1602 10332 20200 39875 40112 52015
>> 60002 7//// 8//// 90550 333 0//// 10440 20303 30/// 4//// 50
>> [8515] 140725/0228[SF -10]  Station 76161 is not in file.
>>
>> Something that is in a format that's ready to be pushed through dclsfc
>> would be great... or already in gempak format would be even better!
>>
>> Thanks,
>> -Mike
>>
>> _______________________________________________
>> gembud mailing list
>> gembud@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: 
> <http://mailman.unidata.ucar.edu/mailing_lists/archives/gembud/attachments/20140725/357a736d/attachment.html>
>
> ------------------------------
>
> Message: 4
> Date: Fri, 25 Jul 2014 12:25:10 +0000
> From: "Pettee, Warren" <wpettee@xxxxxxxx>
> To: "gembud@xxxxxxxxxxxxxxxx" <gembud@xxxxxxxxxxxxxxxx>
> Subject: [gembud] NMap2 on Ubuntu
> Message-ID: <1406291110349.54856@xxxxxxxx>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hello again,
>
>
> (Got one more question after this one, sorry about the inundation of emails)
>
>
> I have installed all of the fonts that Ubuntu is lacking to run the nprogs, 
> thus those errors no longer appear. But has anyone tried to access NMap2 from 
> Ubuntu and noticed that the product selection interface is very.. 
> temperamental? The list boxes get smaller and smaller as you move through 
> subsequent categories, and when you go back to select another product, the 
> menu is stuck in its collapsed state. Only solution at that point is to 
> restart NMap. Is there another X-11 library aside from the fonts that Ubuntu 
> needs?
>
>
> (Our lab computers are running Ubuntu now.. I'm assuming to stop student 
> complaints about the interface and lack of Chrome.)
>
>
> Thanks again,
>
>
> -Warren
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: 
> <http://mailman.unidata.ucar.edu/mailing_lists/archives/gembud/attachments/20140725/33457d46/attachment.html>
>
> ------------------------------
>
> _______________________________________________
> gembud mailing list
> gembud@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit: 
> http://www.unidata.ucar.edu/mailing_lists/ 
>
> End of gembud Digest, Vol 66, Issue 3
> *************************************
>