[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #HPT-985091]: NEXRAD2 concatenating with l2assemble.py



Ziv,

Here's the reply I sent on 29 January (maybe it got sent to spam?):

Ziv,

Yes, the script will assemble the chunks together in the proper order (and
goes through a lot to try to make sure it waits for them all). You can
write out the bzipped chunks concatenated together, or you can have the
chunks decompressed and compress the whole file with gzip or bz2.

Here's an example pqact:

#
# ---------------------------------
# - NEXRAD Level II Radar WSR-88D -
# ---------------------------------
#
CRAFT
^L2-BZIP2/(....)/([0-9][0-9][0-9][0-9][0-1][0-9][0-3][0-9])([0-2][0-9][0-5][0-9][0-9][0-9])/([0-9]*)/[0-9]*/(S|I|E)
PIPE -metadata
/opt/ldm/ldm-alchemy/l2assemble.py -v -t 960 -d
/data/ldm/pub/native/radar/level2
-g -p "{0.dt:%%Y/%%m/%%d}/{0.site}" -n
"{0.site}{0.dt:%%Y%%m%%d_%%H%%M%%S}_{0.version}"
-f gz --threads 20

This puts all data under /data/ldm/pub/native/radar/level2, arranges data
using subirectories like 2016/01/29/KDMX and names the gzipped files as
KDMX20160129_125603_V03.gz

Many of these options have sensible defaults and don't need to be given.
Running l2assemble.py -h should give help on most of these options.

Ryan



Ticket Details
===================
Ticket ID: HPT-985091
Department: Support IDD
Priority: Normal
Status: Closed