[ldm-users] NOAAPort Product Latency - Report Synopsis

  • To: "Karen Cooper - NOAA Affiliate" <karen.cooper@xxxxxxxx>
  • Subject: [ldm-users] NOAAPort Product Latency - Report Synopsis
  • From: "Patrick L. Francis" <wxprofessor@xxxxxxxxx>
  • Date: Wed, 12 Oct 2016 14:51:08 +0000

On the issue of product latency Karen asked:

Out of curiousity, is it possible you recieved the files earlier, and that you re-received them later?

So I wrote a specific action to file RTMA products by valid time, PARM, and receipt time.. then created a text file of all associated file names covering a roughly 24 hour period... I then imported that file into excel for analysis and created pivot tables to see if I could better understand what was going on.

Here notice the left column is how I actually filed the data.. with the valid time of the data, then FHR, PARM, and then the pqact "%Y%m%d%H.grib2" for time that the data was received via my dishes.

From this I created a pivot table to show the count of products
received, over each valid hour.. This was to confirm if Karen's suspicions were correct. The results look as follows:

I colored the outliers in red so that they can be easily seen.. So remember this is how many products were received with that VALID time, or the time the data was valid for. Thus if more than the normal of 20 or so products were received, this would mean multiple reissues, showing that Karen was indeed correct... The times that the reissues occurred was:

Where for 15z a total of 83 RTMA products were transmitted over the dish, 73 for 16z, 56 for 18z and so forth... So we know that much is true.. Cudos Karen! :)

The question remains though, why I received errors due to product delay? What I have done for now is to write a double redundancy check, so that if something is amiss with the data it will autofetch from the ncep servers.

If anyone would like to view or play with the data I used to analyze data receipt, the Excel spreadsheet, including the pivot table, is available here (Excel 2016):

Also included is a raw text file of the filenames containing the VALID time and receipt time, in case you do not have excel :)



Patrick L. Francis
Vice President of Research & Development



PNG image

PNG image

PNG image

  • 2016 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: