[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Datastream #SWJ-684609]: Accessing NEXRAD Level 3 data
- Subject: [Datastream #SWJ-684609]: Accessing NEXRAD Level 3 data
- Date: Mon, 19 Dec 2022 17:58:31 -0700
Greetings,
Thank you for writing in, sorry to hear about the trouble accessing the Level 3
data.
After consulting a colleague we found that S3 bucket should work despite the
data not showing up when you click the bucket link; this is something of a
known issue. But we've been able to verify that data is actually there.
Here's some Python code that helps confirm this:
import boto3
import botocore
from botocore.client import Config
s3 = boto3.resource('s3', config=Config(signature_version=botocore.UNSIGNED,
user_agent_extra='Resource'))
bucket = s3.Bucket('unidata-nexrad-level3')
ret = bucket.meta.client.list_objects(Bucket='unidata-nexrad-level3',
Prefix='INX_NVW_2022_10_03_', Delimiter='_')
print([p['Prefix'] for p in ret['CommonPrefixes']])
['INX_NVW_2022_10_03_00_', 'INX_NVW_2022_10_03_01_',
'INX_NVW_2022_10_03_02_', ...]
If you're still not able to use that S3 bucket in your workflow please let us
know.
I'll add there are other ways to find Nexrad Level 3 data: We also offer a
THREDDS server where this data is available (links below), and that can be
remotely accessed using our Siphon package. And I know you said you're not
looking to download the data directly, but there is also the NCEI database from
NOAA which hosts a REST API you might be able to utilize. And while I suspect
this may not be what you're looking for, if you're interested in more of a push
service for real-time data we can talk about installing LDM to have that data
delivered to you, but this is a more involved way of doing things at least in
terms of installation & setup.
Our Nexrad L3 THREDDS catalog:
https://thredds.ucar.edu/thredds/catalog/nexrad/level3/catalog.html
NCEI's Nexrad L3 page:
https://www.ncei.noaa.gov/access/metadata/landing-page/bin/iso?id=gov.noaa.ncdc:C00708
Info about the Siphon Python package:
https://www.unidata.ucar.edu/software/siphon/
Info about our LDM software:
https://www.unidata.ucar.edu/software/ldm/
I hope this helps, please let us know if you have any other questions.
Best,
-Mike
> Hello,
>
> I am a graduate student currently accessing NEXRAD Level 2 data through
> AWS. I was hoping to get hold of Level 3 data instead. In AWS, there is a
> bucket for Level 3 but with no data in it. I see how to download Level 3
> data on the NOAA/Unidata sites, but I don't want to download. I would like
> to remotely access Level 3 data similar to how I access Level 2 data. Is
> there a way to do this? Storing large amounts of data locally is currently
> inconvenient for my work.
>
> Thank you,
Ticket Details
===================
Ticket ID: SWJ-684609
Department: Support Datastream
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata
inquiry tracking system and then made publicly available through the web. If
you do not want to have your interactions made available in this way, you must
let us know in each email you send to us.