MRMS Hourly Zip Files

NEW! NOAA MRMS Amazon Archive with data since 21 July 2022.

This service maintains about a 30 TB near-term archive of NCEP MRMS data. Since local storage is limited, older content is offloaded to Iowa State's box.com presence called "CyBox". Through some magic, redirection URIs are maintained here to allow scripted access against Cybox.

Filename Convention: YYYY/mm/dd/YYYYmmddHH24.zip. For example, a filepath named 2022/01/01/2022010112.zip would be the MRMS content between 12 and 13 UTC on January 1, 2022.

When browsing content on this server, you may see a zip file with only about 70 byte size reported. This file is a virtual file that is redirected to CyBox on request.

Example wget command to download file.

wget -L -O 2021060100.zip https://mrms.agron.iastate.edu/2021/06/01/2021060100.zip

The `-L` is important to handle the redirect and the `-O` is import to get the downloaded filename right after getting redirected.

Example python code to download two days worth of content.

import datetime
import subprocess

# Get hourly files from June 1 and June 2 2021
now = datetime.datetime(2021, 6, 1, 0)
utc_end = datetime.datetime(2021, 6, 3, 0)

while now < utc_end:
    cmd = (
        'wget -L -O ' + now.strftime('%Y%m%d%H') + '.zip ' +
        'https://mrms.agron.iastate.edu/' + now.strftime('%Y/%m/%d/%Y%m%d%H') + '.zip'
    )
    print(cmd)
    subprocess.run(cmd, shell=True)
    now += datetime.timedelta(hours=1)

Zip Bomb Protection

For reasons I am unsure of, you may get errors unzipping the files. Here are two known workarounds for this.

UNZIP_DISABLE_ZIPBOMB_DETECTION=TRUE unzip filename.zip

or

zip -FF filename.zip --out newfilename.zip and then extract the newly created zipfile.

Please contact daryl herzmann akrherz@iastate.edu with any questions.

[ICO]NameLast modifiedSizeDescription

[DIR]2019/ 2023-10-20 20:46 -  
[DIR]2020/ 2023-10-26 21:38 -  
[DIR]2021/ 2022-10-22 19:26 -  
[DIR]2022/ 2023-06-13 14:06 -  
[DIR]2023/ 2024-01-21 13:37 -  
[DIR]2024/ 2024-11-01 01:33 -