[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[IDD #JNM-107366]: Configuration Files
- Subject: [IDD #JNM-107366]: Configuration Files
- Date: Fri, 15 Jun 2007 15:17:11 -0600
Hi Massoud,
re:
> Thanks for your response. I'll make some changes to the configuration files
> on Friday based on your suggestions.
Very good.
> In the meantime, could you tell me for
> sure if the GFS-CONUS-80km and NAM-CONUS_80km are contained in HDS or some
> other primary name?
The 80 km GFS data are in the HDS datastream. The 12 km NAM data are in the
NGRID datastream.
> Also, how much disk space does would they take up?
The amount of space needed entirely depends on how much data you intend to
keep. In order to get and idea of the volume of data, you can do either
or both of two things:
- visit our IDD information site and look at HDS and NGRID data volumes. For
instance:
Unidata HomePage
http://www.unidata.ucar.edu
Tools -> IDD
http://www.unidata.ucar.edu/software/idd/
Real-Time IDD statistics
http://www.unidata.ucar.edu/software/idd/rtstats/
Statistics by Host
http://www.unidata.ucar.edu/software/idd/rtstats/siteindex.php
idd.unidata.ucar.edu [6.6.3]
http://www.unidata.ucar.edu/software/idd/rtstats/siteindex.php?idd.unidata.ucar.edu
Cumulative volume summary
http://www.unidata.ucar.edu/cgi-bin/rtstats/rtstats_summary_volume?idd.unidata.ucar.edu
The following is an example listing of what you will see in the last URL:
Data Volume Summary for idd.unidata.ucar.edu
Maximum hourly volume 11415.280 M bytes/hour
Average hourly volume 3630.928 M bytes/hour
Average products per hour 174837 prods/hour
Feed Average Maximum Products
(M byte/hour) (M byte/hour) number/hour
CONDUIT 1896.563 [ 52.234%] 10072.116 45329.809
NEXRAD2 791.096 [ 21.788%] 1020.468 53536.957
NGRID 306.143 [ 8.432%] 1119.637 10429.468
HDS 191.025 [ 5.261%] 654.239 18264.511
NIMAGE 190.768 [ 5.254%] 351.156 195.957
NNEXRAD 147.235 [ 4.055%] 174.038 22390.957
FNEXRAD 63.914 [ 1.760%] 80.842 74.468
UNIWISC 22.405 [ 0.617%] 33.294 26.362
IDS|DDPLUS 17.838 [ 0.491%] 25.837 24425.745
GEM 1.893 [ 0.052%] 22.248 130.723
FSL2 1.887 [ 0.052%] 2.081 22.106
NLDN 0.161 [ 0.004%] 0.544 9.617
- the second option is to run 'notifyme' and sum the sizes of products in each
of the datastreams you are interested in. For example:
$ notifyme -vxl- -f NGRID -o 3600
Jun 15 21:15:20 notifyme[32135] NOTE: Starting Up: localhost:
20070615201520.519 TS_ENDT {{NGRID, ".*"}}
Jun 15 21:15:20 notifyme[32135] NOTE: LDM-5 desired product-class:
20070615201520.519 TS_ENDT {{NGRID, ".*"}}
Jun 15 21:15:20 notifyme[32135] INFO: Resolving localhost to 127.0.0.1 took
0.000494 seconds
Jun 15 21:15:20 DEBUG: NOTIFYME(localhost) returns OK
Jun 15 21:15:20 notifyme[32135] NOTE: NOTIFYME(localhost): OK
Jun 15 21:15:21 notifyme[32135] INFO: 88dc87ead929b2c116eaf41b6dafd7c1 44113
20070615201521.104 NGRID 23532203 LVBG10 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/VREL/100 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 914aed9c4cf2374d6c1a133f305b449b 44149
20070615201521.124 NGRID 23532204 LUBG10 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/UREL/100 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 85c3475e2e779e872d5088e24e3798eb 82618
20070615201521.146 NGRID 23532205 LOBG92 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/OMEG/925 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 8e02dbd9f128df5f524a5cf4091b84ea 54922
20070615201521.173 NGRID 23532206 LCBG99 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/AVOR/1000 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 36ecdc7e04d241da9123660e200492df 231847
20070615201521.559 NGRID 23532207 LPBG98 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/PRES/0 - NONE
Jun 15 21:15:21 notifyme[32135] INFO: 7259bcb1e877067d38534be4b6288f00 39308
20070615201521.608 NGRID 23532208 LTBG10 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/TMPK/100 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 17e740f630c7537ee136bfa0f8f9fcda 87702
20070615201521.626 NGRID 23532209 LOBG91 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/OMEG/875 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 24c682a0d46879bf0131e16e7d70eec7 90597
20070615201521.645 NGRID 23532210 LOBG77 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800F036/OMEG/775 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 756adcd1f23fe9c51ce042ba63c6384b 84467
20070615201522.064 NGRID 23532211 LOBG67 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800/F036/
Jun 15 21:15:21 notifyme[32135] INFO: 94086c2101636dba0472de06da2362ab 89349
20070615201522.100 NGRID 23532212 LOBG75 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800/F036/
Jun 15 21:15:21 notifyme[32135] INFO: b1a47c812c620d8d4d6effda30d87907 80683
20070615201522.136 NGRID 23532213 LOBG62 KWBE 151800
!grib2/ncep/NAM_84/#218/200706151800/F036/
The first field after the MD5 product signature is the size of the product in
bytes. Run 'notifyme'
for awhile to get a representative overview of the products in the datastream;
sum the bytes; and
you will see how much disk space it will take to save them.
I think that the first way to get an idea is the best.
> Thanks again.
>
> Massoud
>
>
Cheers,
Tom
****************************************************************************
Unidata User Support UCAR Unidata Program
(303) 497-8642 P.O. Box 3000
address@hidden Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage http://www.unidata.ucar.edu
****************************************************************************
Ticket Details
===================
Ticket ID: JNM-107366
Department: Support IDD
Priority: Normal
Status: Closed
