[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Datastream #SWJ-684609]: Accessing NEXRAD Level 3 data

Greetings,

Thank you for writing in, sorry to hear about the trouble accessing the Level 3 
data.

After consulting a colleague we found that S3 bucket should work despite the 
data not showing up when you click the bucket link; this is something of a 
known issue.  But we've been able to verify that data is actually there.  
Here's some Python code that helps confirm this:

import boto3
import botocore
from botocore.client import Config
s3 = boto3.resource('s3', config=Config(signature_version=botocore.UNSIGNED, 
user_agent_extra='Resource'))
bucket = s3.Bucket('unidata-nexrad-level3')
ret = bucket.meta.client.list_objects(Bucket='unidata-nexrad-level3', 
Prefix='INX_NVW_2022_10_03_', Delimiter='_')
print([p['Prefix'] for p in ret['CommonPrefixes']])

    ['INX_NVW_2022_10_03_00_', 'INX_NVW_2022_10_03_01_', 
'INX_NVW_2022_10_03_02_', ...]


If you're still not able to use that S3 bucket in your workflow please let us 
know.

I'll add there are other ways to find Nexrad Level 3 data:  We also offer a 
THREDDS server where this data is available (links below), and that can be 
remotely accessed using our Siphon package. And I know you said you're not 
looking to download the data directly, but there is also the NCEI database from 
NOAA which hosts a REST API you might be able to utilize.  And while I suspect 
this may not be what you're looking for, if you're interested in more of a push 
service for real-time data we can talk about installing LDM to have that data 
delivered to you, but this is a more involved way of doing things at least in 
terms of installation & setup.

Our Nexrad L3 THREDDS catalog:
https://thredds.ucar.edu/thredds/catalog/nexrad/level3/catalog.html

NCEI's Nexrad L3 page:
https://www.ncei.noaa.gov/access/metadata/landing-page/bin/iso?id=gov.noaa.ncdc:C00708

Info about the Siphon Python package:
https://www.unidata.ucar.edu/software/siphon/

Info about our LDM software:
https://www.unidata.ucar.edu/software/ldm/


I hope this helps, please let us know if you have any other questions.

Best,
-Mike



> Hello,
> 
> I am a graduate student currently accessing NEXRAD Level 2 data through
> AWS. I was hoping to get hold of Level 3 data instead. In AWS, there is a
> bucket for Level 3 but with no data in it. I see how to download Level 3
> data on the NOAA/Unidata sites, but I don't want to download. I would like
> to remotely access Level 3 data similar to how I access Level 2 data. Is
> there a way to do this? Storing large amounts of data locally is currently
> inconvenient for my work.
> 
> Thank you,

Ticket Details
===================
Ticket ID: SWJ-684609
Department: Support Datastream
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.