[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[LDM #LJY-425624]: NEXRAD Level II Feed



Alan,

> I apologize, I made an assumption that it was fairly common knowledge
> about the NCDC NEXRAD archive.  NCDC has always unbzipped the files,
> accumulate the radial files, then compress them using standard unix
> compress and tar them into 8 hour tar files.  This will change with the
> SuperRes from 8 hour tar files to one hour tar files and gzip instead of
> unix compress.

That knowledge probably is common.  Just shows you how much I get out. :-)

> I run two pqacts simultaneously.   pqact_1.conf entry:
> 
> # NEXRAD Level II  L2-BZIP2/KTBW/20080320021133/100/29/E
> NEXRAD2
> ^L2-BZIP2/((K[ACEGIKMOQSUWY]..)/(........)(......)/(.|..|...)/(.|..|...)($|/E$))
> PIPE    -close  /proc_sm/gtsnp/bin/gtsnp_nr2decomp nr2_\2\3_\4 \1
> 
> and pqact_2.conf entry:
> # NEXRAD Level II
> NEXRAD2
> ^L2-BZIP2/((K[BDFHJLNPRTVXZ]..)/(........)(......)/(.|..|...)/(.|..|...)($|/E$))
> PIPE    -close  /proc_sm/gtsnp/bin/gtsnp_nr2decomp nr2_\2\3_\4 \1
> NEXRAD2 ^L2-BZIP2/(([^K]...)/(........)(......)).(.|..)/(.|..|...)($|/E$)
> PIPE    -close  /proc_sm/gtsnp/bin/gtsnp_nr2decomp nr2_\2\3_\4 \1
> 
> The software used is Harry Edmond's nexradII C program that has been
> slightly updated with NSSL's input.  I can provide it if you like.
> 
> The shell script gtsnp_nr2decomp is very simple:
> 
> #!/bin/sh
> #gtsnp_nr2decomp will decompress the nexrad file received from the network.
> # A file that does not have a begining will not be processed.
> gtsnpHOME=/proc_sm/gtsnp
> gtsnpDATA=$gtsnpHOME/data
> gtsnpTMP=$gtsnpHOME/tmp
> gtsnpLOG=$gtsnpHOME/logs
> gtsnpLAT=$gtsnpHOME/lats
> gtsnpLOGFN=$gtsnpLOG/$(date '+%Y%m%d').nr2decomp
> if [ ! -a $gtsnpLOGFN ];then
> touch $gtsnpLOGFN
> fi
> gtsnpSEQFN=$gtsnpLOG/$(date '+%Y%m%d').nr2seq
> if [ ! -a $gtsnpSEQFN ];then
> touch $gtsnpSEQFN
> fi
> 
> gtsnpSHM=/dev/shm
> export PATH=$gtsnpHOME/bin:$PATH
> 
> gtsnpFN=$gtsnpSHM/$1
> gtsnpRAD=$(echo $2 |cut -f4 -d'/') #number of 100 Radials   i.e. $2 =
> KGSP/20041104151754/160/17
> gtsnpVS=$(echo $2 |cut -f3 -d'/') #Volume scan
> gtsnpEND=$(echo $2 |cut -f5 -d'/') #E if this is the end
> gtsnpSID=$(echo $2 |cut -f1 -d'/') #Station ID
> gtsnpSID1=$(echo $gtsnpSID |cut -c1) #Station ID first character
> gtsnpYMDHMS=$(echo $2 |cut -f2 -d'/') #Timestamp
> 
> if ([ $gtsnpSID1 != "R" ] && [ $gtsnpRAD -eq 1 ]) || ([ $gtsnpSID1 ==
> "R" ] && [ $gtsnpRAD -eq 0 ]);then
> if [ -s $gtsnpFN ];then
> rm $gtsnpFN 1>>$gtsnpLOGFN 2>&1
> echo "$(basename $0): Removed: $1 $2 RAD: $gtsnpRAD $(date
> '+%H:%M:%S')" >> $gtsnpLOGFN
> fi
> elif [ $gtsnpRAD -gt 1 ] && [ ! -s $gtsnpFN ];then
> gtsnpFN=/dev/null
> echo "$(basename $0): No Begining: $1 $2 RAD: $gtsnpRAD $(date
> '+%H:%M:%S')" >> $gtsnpLOGFN
> fi
> 
> nexradII -v -l $gtsnpLOGFN $gtsnpFN 1>>$gtsnpLOGFN 2>&1
> if [ $? -ge 0 ];then
> if [ $gtsnpEND = 'E' ];then
> nohup gtsnp_nr2comp $gtsnpSHM $1 1>>$gtsnpLOGFN 2>&1 &
> fi
> else
> echo "$(basename $0): bunzip failed $2 $(date '+%H:%M:%S')" >> $gtsnpLOGFN
> fi

Do the gtsnp_nr2decomp(1) log files in /proc_sm/gtsnp/logs indicate
anything amiss (e.g., "No Begining")?

Regards,
Steve Emmerson

Ticket Details
===================
Ticket ID: LJY-425624
Department: Support LDM
Priority: Normal
Status: On Hold


NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.