Re: [ldm-users] Reading GOES-16 data?

  • To: "Patrick L. Francis" <wxprofessor@xxxxxxxxx>, Arthur A Person <aap1@xxxxxxx>
  • Subject: Re: [ldm-users] Reading GOES-16 data?
  • From: "Herbster, Christopher G." <herbstec@xxxxxxxx>
  • Date: Fri, 14 Apr 2017 16:51:12 +0000
  • Authentication-results: gmail.com; dkim=none (message not signed) header.d=none;gmail.com; dmarc=none action=none header.from=erau.edu;
  • Spamdiagnosticmetadata: NSPM
  • Spamdiagnosticoutput: 1:99
Thanks to those that confirmed the files are corrupt.  I also have to update 
our NetCDF libraries.

We also got some code to tweak our NOAAPort receiver, which may be part of the 
problem.  (Too many degrees of freedom trying to debug this one!)

Thanks again for the assistance!

Cheers,
Chris
--

Dr. Christopher G. Herbster
Associate Professor
Director of Science and Technology
for the ERAU Weather Center
Applied Aviation Sciences
Embry-Riddle Aeronautical Univ.
600 S. Clyde Morris Blvd.
Daytona Beach, FL 32114-3900
 386.226.6444 Office
386.226.6446 Weather Center
http://wx.erau.edu/

Schedule at:  http://wx.erau.edu/faculty/herbster/Schedules/

From: Patrick L. Francis [mailto:wxprofessor@xxxxxxxxx]
Sent: Thursday, April 13, 2017 7:13 PM
To: Arthur A Person <aap1@xxxxxxx>; Herbster, Christopher G. <herbstec@xxxxxxxx>
Cc: Devin Eyre <Devin.Eyre@xxxxxxxxxxxx>; ldm-users@xxxxxxxxxxxxxxxx
Subject: Re[2]: [ldm-users] Reading GOES-16 data?


This is what I use and sent to some friends instead of the python script:


ex -sc '1d3|x'  file



the above is using vim in ex mode...  you are telling vim to "start at line 1, 
and delete the first three lines" of the file.. I don't know why they force the 
headers on every product, when I emailed about it, they simply said "that's the 
way it's always been" ... however, doing the above allows at least normal 
netcdf drivers to read the files.   [:-)]

it could also be your file actions.. if you are stuffing more than one sector 
within the same file you would have multiple headers (and footers) within a 
single entity.

cheers,

--patrick


ââââââââââââââââââââââ...........
Patrick L. Francis
Director of Research & Development
Aeris Weather

http://aerisweather.com/
http://modelweather.com/


wxprofessor@xxxxxxxxx<mailto:wxprofessor@xxxxxxxxx>
http://facebook.com/wxprofessor/

ââââââââââââââââââââââ

..




------ Original Message ------
From: "Arthur A Person" <aap1@xxxxxxx<mailto:aap1@xxxxxxx>>
To: "Herbster, Christopher G." <herbstec@xxxxxxxx<mailto:herbstec@xxxxxxxx>>
Cc: "Patrick L. Francis" <wxprofessor@xxxxxxxxx<mailto:wxprofessor@xxxxxxxxx>>; 
"Devin Eyre" <Devin.Eyre@xxxxxxxxxxxx<mailto:Devin.Eyre@xxxxxxxxxxxx>>; 
ldm-users@xxxxxxxxxxxxxxxx<mailto:ldm-users@xxxxxxxxxxxxxxxx>
Sent: 4/13/2017 7:06:47 PM
Subject: Re: [ldm-users] Reading GOES-16 data?

Chris,

Wont' read here.  Looks like you need to remove another 21 bytes from the 
beginning of the file.

         Art

________________________________
From: "Herbster, Christopher G." <herbstec@xxxxxxxx<mailto:herbstec@xxxxxxxx>>
To: "Patrick L. Francis" <wxprofessor@xxxxxxxxx<mailto:wxprofessor@xxxxxxxxx>>, 
"Devin Eyre" <Devin.Eyre@xxxxxxxxxxxx<mailto:Devin.Eyre@xxxxxxxxxxxx>>, 
ldm-users@xxxxxxxxxxxxxxxx<mailto:ldm-users@xxxxxxxxxxxxxxxx>
Sent: Thursday, April 13, 2017 6:57:49 PM
Subject: Re: [ldm-users] Reading GOES-16 data?
Could someone out there please try to read these files so I know if it is my 
NetCDF library?

Thanks!

Here are some of the RAW files (without the chomp.py script utilized)
http://wx.erau.edu/faculty/herbster/demo/data/GOES-16/RAW

Here are the same files after using âchomp.pyâ
http://wx.erau.edu/faculty/herbster/demo/data/GOES-16/NC

I would sure like to know if these are valid files before I go any further down 
my build HDF5, Zlib, NetCDF, CDO rabbit hole!

Thanks in advance,

Chris H.
--

Dr. Christopher G. Herbster
Associate Professor
Director of Science and Technology
for the ERAU Weather Center
Applied Aviation Sciences
Embry-Riddle Aeronautical Univ.
600 S. Clyde Morris Blvd.
Daytona Beach, FL 32114-3900
 386.226.6444 Office
386.226.6446 Weather Center
http://wx.erau.edu/

Schedule at:  http://wx.erau.edu/faculty/herbster/Schedules/

From: Patrick L. Francis 
[mailto:wxprofessor@xxxxxxxxx<mailto:wxprofessor@xxxxxxxxx>]
Sent: Thursday, April 13, 2017 6:02 PM
To: Devin Eyre <Devin.Eyre@xxxxxxxxxxxx<mailto:Devin.Eyre@xxxxxxxxxxxx>>; 
Herbster, Christopher G. <herbstec@xxxxxxxx<mailto:herbstec@xxxxxxxx>>; 
ldm-users@xxxxxxxxxxxxxxxx<mailto:ldm-users@xxxxxxxxxxxxxxxx>
Subject: Re[2]: [ldm-users] Reading GOES-16 data?

You might need to upgrade netcdf libraries.  I've found that version 4.1.2 
doesn't work, but 4.3.0 does.

don't forget if you update your netcdf you also have to update your HDF5 [=-O] 
... note the reference here:

http://www.unidata.ucar.edu/blogs/news/entry/netcdf-4-4-1

get your source HDF5 here [:-)] :

https://support.hdfgroup.org/HDF5/release/obtainsrc518.html#src

cheers,

--patrick


ââââââââââââââââââââââ...........
Patrick L. Francis
Director of Research & Development
Aeris Weather

http://aerisweather.com/
http://modelweather.com/


wxprofessor@xxxxxxxxx<mailto:wxprofessor@xxxxxxxxx>
http://facebook.com/wxprofessor/

ââââââââââââââââââââââ

..




_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web.  Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.


ldm-users mailing list
ldm-users@xxxxxxxxxxxxxxxx<mailto:ldm-users@xxxxxxxxxxxxxxxx>
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/

--
Arthur A. Person
Research Assistant, System Administrator
Penn State Department of Meteorology and Atmospheric Science
email:  aap1@xxxxxxx<mailto:aap1@xxxxxxx>, phone:  814-863-1563

PNG image

PNG image