[ldm-users] GRB data feed issues - incomplete files/gaps?

  • To: NSF Unidata General Support/Unable To Determine <support@xxxxxxxxxxxxxxxx>, LDM <ldm-users@xxxxxxxxxxxxxxxx>
  • Subject: [ldm-users] GRB data feed issues - incomplete files/gaps?
  • From: Pete Pokrandt <poker@xxxxxxxxxxxx>
  • Date: Wed, 6 Aug 2025 16:16:36 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=aos.wisc.edu; dmarc=pass action=none header.from=aos.wisc.edu; dkim=pass header.d=aos.wisc.edu; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fqh0T32whZb4+tpM+bNANVHdLrjfU+XsuZA6k7S6jkg=; b=zKA5ZizwEJvvrH5YNNd232q19GWqp2cZfSux1Cou1tjR7FTYCB2cdHcH14YVBtJUhGqxmp2atWGrXOWOwoVeDUIPh5X7PjrUuAO8ghW5Jyeu2ttW+qx6OLSvLlR7zI04tdvFhjI2n0UWYd1OztBUNrJfVeC1/99UhUy68dgvXNLtTuBaDprt4u3oDwD3+ByLMvy2qUBwb99OHiP4nAvoMrEnqIx9Ipl1RX9zGvFmpiX3rbFrS7CWYLW013AuZYykhGHBSXPobKAUdWLdoL9NLJVm8xH/plVLnL31j3GXeTR4jP4ZxL+TEUPNhRgcLcZXuH9hehhe9zrLg5tDZfgiJg==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=gbpLrfviwGH6sUsiO5R1HlPV8UJ8Mbs0YF0eWT9WBOYNckkSwRb+S0RbawhzzQnvSaRlP/TpzrG42RiC+mYyBN/50tgRjo7lO/0iDt+Jnf67zw/HgwlE/np73EWOoBZKmDvy6QwZWjJJ4Wawm4rPP5FUeaxtagqSbfGl4b/50Sjt3lkRX/4xY/u866SHYgZ/08yqExdzUXYj8jCz9Z7Tk03UmRoPiY2F7FA1Rir9GNc3/8GPqBA6rbZAuBCggCglhZA7i4/H24ObuzyeEBk0sgpEQay+iiWsf2vjYpxoKdOttOZlG45Vew4NzemLxlT9fI6AMmAU61eO0Kmp+qfF5A==
  • Msip_labels:
Hi all,

I've noticed the past several days there are gaps in many of the GRB data 
files. Here's an example from the GOES 19 ABI channel 2 (red visible band) from 
this morning.

Here are the file sizes for the files that I have received for the past few 
hours

-rw-rw-r--. 1 ldm ldm 328635079 Aug  6 07:10 
OR_ABI-L1b-RadF-M6C02_G19_s20252181200206_e20252181209514_c20252181209552.nc
-rw-rw-r--. 1 ldm ldm 334304629 Aug  6 07:21 
OR_ABI-L1b-RadF-M6C02_G19_s20252181210206_e20252181219514_c20252181219537.nc
-rw-rw-r--. 1 ldm ldm 339713187 Aug  6 07:31 
OR_ABI-L1b-RadF-M6C02_G19_s20252181220206_e20252181229514_c20252181229553.nc
-rw-rw-r--. 1 ldm ldm 344622117 Aug  6 07:40 
OR_ABI-L1b-RadF-M6C02_G19_s20252181230206_e20252181239514_c20252181239545.nc
-rw-rw-r--. 1 ldm ldm  99635697 Aug  6 07:50 
OR_ABI-L1b-RadF-M6C02_G19_s20252181240206_e20252181249514_c20252181249552.nc
-rw-rw-r--. 1 ldm ldm 355223647 Aug  6 08:00 
OR_ABI-L1b-RadF-M6C02_G19_s20252181250206_e20252181259514_c20252181259545.nc
-rw-rw-r--. 1 ldm ldm 361019443 Aug  6 08:10 
OR_ABI-L1b-RadF-M6C02_G19_s20252181300206_e20252181309514_c20252181309546.nc
-rw-rw-r--. 1 ldm ldm 365952779 Aug  6 08:21 
OR_ABI-L1b-RadF-M6C02_G19_s20252181310206_e20252181319514_c20252181319547.nc
-rw-rw-r--. 1 ldm ldm 371623853 Aug  6 08:31 
OR_ABI-L1b-RadF-M6C02_G19_s20252181320206_e20252181329514_c20252181329556.nc
-rw-rw-r--. 1 ldm ldm 376025396 Aug  6 08:40 
OR_ABI-L1b-RadF-M6C02_G19_s20252181330206_e20252181339514_c20252181339541.nc
-rw-rw-r--. 1 ldm ldm 381338035 Aug  6 08:50 
OR_ABI-L1b-RadF-M6C02_G19_s20252181340206_e20252181349514_c20252181349561.nc
-rw-rw-r--. 1 ldm ldm 385625318 Aug  6 09:00 
OR_ABI-L1b-RadF-M6C02_G19_s20252181350206_e20252181359514_c20252181359542.nc
-rw-rw-r--. 1 ldm ldm 390331029 Aug  6 09:10 
OR_ABI-L1b-RadF-M6C02_G19_s20252181400206_e20252181409514_c20252181409535.nc
-rw-rw-r--. 1 ldm ldm  89401307 Aug  6 09:20 
OR_ABI-L1b-RadF-M6C02_G19_s20252181410206_e20252181419514_c20252181419555.nc
-rw-rw-r--. 1 ldm ldm 400133060 Aug  6 09:31 
OR_ABI-L1b-RadF-M6C02_G19_s20252181420206_e20252181429514_c20252181429551.nc
-rw-rw-r--. 1 ldm ldm 404980007 Aug  6 09:41 
OR_ABI-L1b-RadF-M6C02_G19_s20252181430206_e20252181439514_c20252181439557.nc
-rw-rw-r--. 1 ldm ldm 232816097 Aug  6 09:50 
OR_ABI-L1b-RadF-M6C02_G19_s20252181440206_e20252181449514_c20252181449557.nc
-rw-rw-r--. 1 ldm ldm 154056273 Aug  6 10:00 
OR_ABI-L1b-RadF-M6C02_G19_s20252181450206_e20252181459514_c20252181459553.nc
-rw-rw-r--. 1 ldm ldm 416413968 Aug  6 10:11 
OR_ABI-L1b-RadF-M6C02_G19_s20252181500206_e20252181509514_c20252181509546.nc
-rw-rw-r--. 1 ldm ldm 418900344 Aug  6 10:25 
OR_ABI-L1b-RadF-M6C02_G19_s20252181510206_e20252181519514_c20252181519543.nc
-rw-rw-r--. 1 ldm ldm 421060195 Aug  6 10:31 
OR_ABI-L1b-RadF-M6C02_G19_s20252181520206_e20252181529514_c20252181529552.nc
-rw-rw-r--. 1 ldm ldm 423133036 Aug  6 10:41 
OR_ABI-L1b-RadF-M6C02_G19_s20252181530206_e20252181539514_c20252181539551.nc
-rw-rw-r--. 1 ldm ldm 425821389 Aug  6 10:51 
OR_ABI-L1b-RadF-M6C02_G19_s20252181540206_e20252181549514_c20252181549552.nc
-rw-rw-r--. 1 ldm ldm 207945828 Aug  6 11:00 
OR_ABI-L1b-RadF-M6C02_G19_s20252181550206_e20252181559514_c20252181559539.nc

To make sure it isn't just me, I checked on the Unidata THREDDS server and the 
file sizes seem to match what I got

OR_ABI-L1b-RadF-M6C02_G19_s20252181200206_e20252181209514_c20252181209552.nc    
 328.6 Mbytes   2025-08-06T12:10:32.322Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181210206_e20252181219514_c20252181219537.nc    
 334.3 Mbytes   2025-08-06T12:20:31.238Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181220206_e20252181229514_c20252181229553.nc    
 339.7 Mbytes   2025-08-06T12:30:36.489Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181230206_e20252181239514_c20252181239545.nc    
 344.6 Mbytes   2025-08-06T12:40:33.348Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181240206_e20252181249514_c20252181249552.nc    
 99.63 Mbytes   2025-08-06T12:50:07.355Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181250206_e20252181259514_c20252181259545.nc    
 355.2 Mbytes   2025-08-06T13:00:31.939Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181300206_e20252181309514_c20252181309546.nc    
 361.0 Mbytes   2025-08-06T13:10:33.105Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181310206_e20252181319514_c20252181319547.nc    
 365.9 Mbytes   2025-08-06T13:20:33.494Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181320206_e20252181329514_c20252181329556.nc    
 371.6 Mbytes   2025-08-06T13:30:37.876Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181330206_e20252181339514_c20252181339541.nc    
 376.0 Mbytes   2025-08-06T13:40:31.790Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181340206_e20252181349514_c20252181349561.nc    
 381.3 Mbytes   2025-08-06T13:50:10.795Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181350206_e20252181359514_c20252181359542.nc    
 385.6 Mbytes   2025-08-06T14:00:10.330Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181400206_e20252181409514_c20252181409535.nc    
 390.3 Mbytes   2025-08-06T14:10:06.199Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181410206_e20252181419514_c20252181419555.nc    
 89.40 Mbytes   2025-08-06T14:20:01.406Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181420206_e20252181429514_c20252181429551.nc    
 400.1 Mbytes   2025-08-06T14:30:34.302Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181430206_e20252181439514_c20252181439557.nc    
 404.9 Mbytes   2025-08-06T14:40:35.296Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181440206_e20252181449514_c20252181449557.nc    
 232.8 Mbytes   2025-08-06T14:50:04.090Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181450206_e20252181459514_c20252181459553.nc    
 154.0 Mbytes   2025-08-06T15:00:02.672Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181500206_e20252181509514_c20252181509546.nc    
 416.4 Mbytes   2025-08-06T15:10:39.942Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181510206_e20252181519514_c20252181519543.nc    
 418.9 Mbytes   2025-08-06T15:20:37.597Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181520206_e20252181529514_c20252181529552.nc    
 421.0 Mbytes   2025-08-06T15:30:37.023Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181530206_e20252181539514_c20252181539551.nc    
 423.1 Mbytes   2025-08-06T15:40:45.582Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181540206_e20252181549514_c20252181549552.nc    
 425.8 Mbytes   2025-08-06T15:50:50.557Z
OR_ABI-L1b-RadF-M6C02_G19_s20252181550206_e20252181559514_c20252181559539.nc    
 207.9 Mbytes   2025-08-06T16:00:25.938Z

Here's what the imagery looks like when you plot those files

https://whirlwind.aos.wisc.edu/~wxp/goes16/vis/goes16_fulldisk.html

Whatever is causing this is affecting the GOES18 west GRB feed as well.

I did a little poking around and didn't see any admin messages about any data 
processing issues for GOES east/west data.

Any idea what might be causing this?

Thanks,
Pete

Pete Pokrandt - System Engineer IV
UW-Madison Dept of Atmospheric and Oceanic Sciences
608-262-3086  - poker@xxxxxxxxxxxx
  • 2025 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the ldm-users archives: