[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #BLE-413085]: [IDD #ZQK-275228] RE: NLDN data set

Hi Jennifer,

re:
> Here is what I am getting with the above entry in pqact.conf. I don’t think 
> this is right.
> 
> cola.gmu.edu[ldm]:~/data/lightning # ls -l
> total 12
> -rw-r--r-- 1 ldm cola 2940 Aug 29 16:27 2017(2017:mm)2025.nldn
> -rw-r--r-- 1 ldm cola 2016 Aug 29 16:27 2017(2017:mm)2026.nldn
> -rw-r--r-- 1 ldm cola 1652 Aug 29 16:27 2017(2017:mm)2027.nldn
> 
> How should I adjust pqact.conf? I tried changing the “(\1:mm)” to “(\2:ddd)” 
> and now I’m getting files like this:
> # ls -l data/lightning/
> -rw-r--r-- 1 ldm cola 1652 Aug 29 16:49 2017(241:ddd)2049.nldn

Ah Ha!  Given your findings, I think it might be:

# NLDN Lightning data from UAlbany
LIGHTNING 
^([12][0-9][0-9][0-9]|[0-9][0-9])([0-3][0-9][0-9])([0-2][0-9])([0-5][0-9])([0-5][0-9])
   FILE
   data/lightning/\1(\2:mm)(\2:dd)\3\4.nldn

Which, if correct, would result in the output file:

   data/lightning/201708292025.nldn, etc.

re:
> I can live with the julian day instead of MMDD, but how do I get rid
> of the unwanted () and :ddd in the filename?

As soon as we get the syntax right, it will go away.

re:
> Also, will it lump all NLDN records that occur over an hour into one
> file,

Yes.

re:
> or just overwrite so I only get the one latest record in the file?

The default action of FILE is to append to the named output file.
If one wants to overwrite the output file, one has to include the
'-overwrite' flag after FILE (separated by a tab, not space).

re:
> Would it be better to granularize down to the minute?

That is totally up to you and what your use case is.

I saw the note sent to UAlbany asking for the feed of NLDN data
and Jim's email to us asking for guidance on getting access to
the feed when GMU had not gotten a reply in a month:

  "We would like to gain access to the NLDN lightning data for research
  we are conducting that also uses the GOES-16 lightning mapper data."

but I did not see any mention of how the analyses will be done.  It
seems to me that how you decide to store the data on disk will depend
on how you want to use it afterward.

re: what software are you going to be using?

> OK. I will consult with my colleagues to see if they want GEMPAK or
> McIDAS.

Thinking about it, I would say that they will not be using GEMPAK since
there has been no effort to add support for the netCDF4 files of ABI
imagery in GEMPAK, and I extrapolate from that to guess that the same
is likely true for the GLM data that is also in netCDF4.  This is a
guess, however...

re:
> I will write a little C program to convert each record into GrADS station
> data format since that will be the easiest for me to manage.

OK.  Does GrADS support the GLM data?  Just curious...

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: BLE-413085
Department: Support IDD
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.