[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[IDD #TTR-495389]: Slow access to local datasets through ADDE
- Subject: [IDD #TTR-495389]: Slow access to local datasets through ADDE
- Date: Thu, 07 Feb 2008 12:44:08 -0700
Hi Samuel,
re:
> I've opened our allowable hosts, slightly, to allow any connection from
> the following subnets: 128.117.156, 128.117.140, and 131.156.8 (I believe
> weather.admin.niu.edu is in this subnet). Please let me know if this helps.
It does help; I am no able to SSH as both 'mcidas' and 'ldm'.
Right off, I see the problem with accessing all of the imagery in the
RTIMAGES/ANTARCTIC dataset: only the images from 20080206 are in
an appropriately named subdirectory of
/data/ldm/mcidas/images/sat/ANTARCTIC/4km/IR.
The rest of the images are in under
/data/ldm/mcidas/images/sat/ANTARCTIC/4km/IR itself:
-bash-2.05b$ ls /data/ldm/mcidas/images/sat/ANTARCTIC/4km/IR
20080206 IR_20071213_1200 IR_20071227_0900 IR_20080122_1800
IR_20071207_1200 IR_20071213_1500 IR_20071227_1500 IR_20080123_0000
IR_20071207_1500 IR_20071213_1800 IR_20071227_2100 IR_20080123_0300
IR_20071207_1800 IR_20071213_2100 IR_20071229_0300 IR_20080123_0900
IR_20071207_2100 IR_20071214_0000 IR_20071229_0900 IR_20080123_1500
IR_20071208_0000 IR_20071214_1200 IR_20071229_1200 IR_20080124_0000
IR_20071208_0300 IR_20071214_1500 IR_20071229_1800 IR_20080124_1500
IR_20071208_0600 IR_20071215_0600 IR_20071229_2100 IR_20080125_0300
IR_20071208_0900 IR_20071215_0900 IR_20071230_0300 IR_20080125_1200
IR_20071208_1200 IR_20071215_2100 IR_20071230_0900 IR_20080125_1500
IR_20071208_1500 IR_20071216_0900 IR_20071230_1500 IR_20080126_0900
IR_20071208_1800 IR_20071216_1500 IR_20071231_0000 IR_20080126_1500
IR_20071208_2100 IR_20071216_2100 IR_20071231_1500 IR_20080127_0300
IR_20071209_0000 IR_20071217_0300 IR_20080101_0300 IR_20080127_1200
IR_20071209_0300 IR_20071217_0600 IR_20080102_0900 IR_20080127_1500
IR_20071209_0600 IR_20071217_0900 IR_20080103_0000 IR_20080127_2100
IR_20071209_0900 IR_20071217_1500 IR_20080104_1800 IR_20080128_0300
IR_20071209_1200 IR_20071217_2100 IR_20080105_0300 IR_20080128_2100
IR_20071209_1500 IR_20071218_0000 IR_20080105_1800 IR_20080129_0600
IR_20071209_1800 IR_20071218_0300 IR_20080106_0300 IR_20080129_0900
IR_20071209_2100 IR_20071218_0600 IR_20080107_0300 IR_20080129_1200
IR_20071210_0000 IR_20071218_1800 IR_20080107_1200 IR_20080129_1500
IR_20071210_0300 IR_20071219_0300 IR_20080108_0000 IR_20080129_2100
IR_20071210_0600 IR_20071219_0600 IR_20080108_0900 IR_20080130_0300
IR_20071210_0900 IR_20071219_0900 IR_20080108_1200 IR_20080130_1500
IR_20071210_1200 IR_20071221_0300 IR_20080109_0300 IR_20080130_2100
IR_20071210_1500 IR_20071221_0900 IR_20080110_1200 IR_20080131_0900
IR_20071210_1800 IR_20071221_1500 IR_20080110_1500 IR_20080131_1500
IR_20071210_2100 IR_20071221_2100 IR_20080110_1800 IR_20080131_2100
IR_20071211_0000 IR_20071222_0300 IR_20080110_2100 IR_20080201_0000
IR_20071211_0300 IR_20071222_0900 IR_20080111_0900 IR_20080201_0900
IR_20071211_0600 IR_20071222_2100 IR_20080112_1500 IR_20080201_1200
IR_20071211_0900 IR_20071223_0300 IR_20080113_0300 IR_20080202_0300
IR_20071211_1200 IR_20071223_0600 IR_20080114_0300 IR_20080202_1500
IR_20071211_1500 IR_20071223_0900 IR_20080114_2100 IR_20080203_0300
IR_20071211_1800 IR_20071223_1200 IR_20080115_0300 IR_20080203_0600
IR_20071211_2100 IR_20071223_1500 IR_20080115_0600 IR_20080203_1500
IR_20071212_0000 IR_20071224_0300 IR_20080116_0900 IR_20080203_2100
IR_20071212_0300 IR_20071224_0900 IR_20080116_2100 IR_20080204_0300
IR_20071212_0600 IR_20071224_1200 IR_20080118_0900 IR_20080204_0900
IR_20071212_0900 IR_20071224_1500 IR_20080118_2100 IR_20080204_1500
IR_20071212_1200 IR_20071224_2100 IR_20080119_0300 IR_20080204_2100
IR_20071212_1500 IR_20071225_0000 IR_20080119_0900 IR_20080205_0300
IR_20071212_1800 IR_20071225_1200 IR_20080119_2100 IR_20080205_0900
IR_20071212_2100 IR_20071225_1500 IR_20080120_0000 IR_20080205_1500
IR_20071213_0000 IR_20071225_2100 IR_20080120_2100 IR_20080206_0300
IR_20071213_0300 IR_20071226_0300 IR_20080121_0000 IR_20080206_0900
IR_20071213_0600 IR_20071226_2100 IR_20080121_1200
IR_20071213_0900 IR_20071227_0600 IR_20080122_0300
Also, there are no images from today, 20080207.
What is needed is the creation of daily directories and movement of appropriate
images into those directories. For example:
<as 'ldm'>
cd /data/ldm/mcidas/images/sat/ANTARCTIC/4km/IR
mkdir 20071207
mv IR_20071207* 20071207
mkdir 20081208
mv IR_20071208* 20071208
etc.
After doing this for you, I am able to list out all of the Antarctic IR
images you have:
<as 'mcidas' on my home machine>
IMGLIST RTIMAGES/ANTARCTIC.ALL
Image file directory listing for:RTIMAGES/ANTARCTIC
Pos Satellite/ Date Time Center Band(s)
sensor Lat Lon
--- ------------- ------------ -------- ---- ---- ------------
1 G-9 IMG 7 DEC 07341 12:00:00 -90 5 4
2 G-9 IMG 7 DEC 07341 15:00:00 -90 5 4
3 G-9 IMG 7 DEC 07341 18:00:00 -90 5 4
4 G-9 IMG 7 DEC 07341 21:00:00 -90 5 4
5 G-9 IMG 8 DEC 07342 00:00:00 -90 5 4
6 G-9 IMG 8 DEC 07342 03:00:00 -90 5 4
7 G-9 IMG 8 DEC 07342 06:00:00 -90 5 4
8 G-9 IMG 8 DEC 07342 09:00:00 -90 5 4
9 G-9 IMG 8 DEC 07342 12:00:00 -90 5 4
10 G-9 IMG 8 DEC 07342 15:00:00 -90 5 4
11 G-9 IMG 8 DEC 07342 18:00:00 -90 5 4
12 G-9 IMG 8 DEC 07342 21:00:00 -90 5 4
13 G-9 IMG 9 DEC 07343 00:00:00 -90 5 4
14 G-9 IMG 9 DEC 07343 03:00:00 -90 5 4
15 G-9 IMG 9 DEC 07343 06:00:00 -90 5 4
16 G-9 IMG 9 DEC 07343 09:00:00 -90 5 4
17 G-9 IMG 9 DEC 07343 12:00:00 -90 5 4
18 G-9 IMG 9 DEC 07343 15:00:00 -90 5 4
19 G-9 IMG 9 DEC 07343 18:00:00 -90 5 4
20 G-9 IMG 9 DEC 07343 21:00:00 -90 5 4
21 G-9 IMG 10 DEC 07344 00:00:00 -90 5 4
22 G-9 IMG 10 DEC 07344 03:00:00 -90 5 4
23 G-9 IMG 10 DEC 07344 06:00:00 -90 5 4
24 G-9 IMG 10 DEC 07344 09:00:00 -90 5 4
25 G-9 IMG 10 DEC 07344 12:00:00 -90 5 4
26 G-9 IMG 10 DEC 07344 15:00:00 -90 5 4
27 G-9 IMG 10 DEC 07344 18:00:00 -90 5 4
28 G-9 IMG 10 DEC 07344 21:00:00 -90 5 4
29 G-9 IMG 11 DEC 07345 00:00:00 -90 5 4
30 G-9 IMG 11 DEC 07345 03:00:00 -90 5 4
31 G-9 IMG 11 DEC 07345 06:00:00 -90 5 4
32 G-9 IMG 11 DEC 07345 09:00:00 -90 5 4
33 G-9 IMG 11 DEC 07345 12:00:00 -90 5 4
34 G-9 IMG 11 DEC 07345 15:00:00 -90 5 4
35 G-9 IMG 11 DEC 07345 18:00:00 -90 5 4
36 G-9 IMG 11 DEC 07345 21:00:00 -90 5 4
37 G-9 IMG 12 DEC 07346 00:00:00 -90 5 4
38 G-9 IMG 12 DEC 07346 03:00:00 -90 5 4
39 G-9 IMG 12 DEC 07346 06:00:00 -90 5 4
40 G-9 IMG 12 DEC 07346 09:00:00 -90 5 4
41 G-9 IMG 12 DEC 07346 12:00:00 -90 5 4
42 G-9 IMG 12 DEC 07346 15:00:00 -90 5 4
43 G-9 IMG 12 DEC 07346 18:00:00 -90 5 4
44 G-9 IMG 12 DEC 07346 21:00:00 -90 5 4
45 G-9 IMG 13 DEC 07347 00:00:00 -90 5 4
46 G-9 IMG 13 DEC 07347 03:00:00 -90 5 4
47 G-9 IMG 13 DEC 07347 06:00:00 -90 5 4
48 G-9 IMG 13 DEC 07347 09:00:00 -90 5 4
49 G-9 IMG 13 DEC 07347 12:00:00 -90 5 4
50 G-9 IMG 13 DEC 07347 15:00:00 -90 5 4
51 G-9 IMG 13 DEC 07347 18:00:00 -90 5 4
52 G-9 IMG 13 DEC 07347 21:00:00 -90 5 4
53 G-9 IMG 14 DEC 07348 00:00:00 -90 5 4
54 G-9 IMG 14 DEC 07348 12:00:00 -90 5 4
55 G-9 IMG 14 DEC 07348 15:00:00 -90 5 4
56 G-9 IMG 15 DEC 07349 06:00:00 -90 5 4
57 G-9 IMG 15 DEC 07349 09:00:00 -90 5 4
58 G-9 IMG 15 DEC 07349 21:00:00 -90 5 4
59 G-9 IMG 16 DEC 07350 09:00:00 -90 5 4
60 G-9 IMG 16 DEC 07350 15:00:00 -90 5 4
61 G-9 IMG 16 DEC 07350 21:00:00 -90 5 4
62 G-9 IMG 17 DEC 07351 03:00:00 -90 5 4
63 G-9 IMG 17 DEC 07351 06:00:00 -90 5 4
64 G-9 IMG 17 DEC 07351 09:00:00 -90 5 4
65 G-9 IMG 17 DEC 07351 15:00:00 -90 5 4
66 G-9 IMG 17 DEC 07351 21:00:00 -90 5 4
67 G-9 IMG 18 DEC 07352 00:00:00 -90 5 4
68 G-9 IMG 18 DEC 07352 03:00:00 -90 5 4
69 G-9 IMG 18 DEC 07352 06:00:00 -90 5 4
70 G-9 IMG 18 DEC 07352 18:00:00 -90 5 4
71 G-9 IMG 19 DEC 07353 03:00:00 -90 5 4
72 G-9 IMG 19 DEC 07353 06:00:00 -90 5 4
73 G-9 IMG 19 DEC 07353 09:00:00 -90 5 4
74 G-9 IMG 21 DEC 07355 03:00:00 -90 5 4
75 G-9 IMG 21 DEC 07355 09:00:00 -90 5 4
76 G-9 IMG 21 DEC 07355 15:00:00 -90 5 4
77 G-9 IMG 21 DEC 07355 21:00:00 -90 5 4
78 G-9 IMG 22 DEC 07356 03:00:00 -90 5 4
79 G-9 IMG 22 DEC 07356 09:00:00 -90 5 4
80 G-9 IMG 22 DEC 07356 21:00:00 -90 5 4
81 G-9 IMG 23 DEC 07357 03:00:00 -90 5 4
82 G-9 IMG 23 DEC 07357 06:00:00 -90 5 4
83 G-9 IMG 23 DEC 07357 09:00:00 -90 5 4
84 G-9 IMG 23 DEC 07357 12:00:00 -90 5 4
85 G-9 IMG 23 DEC 07357 15:00:00 -90 5 4
86 G-9 IMG 24 DEC 07358 03:00:00 -90 5 4
87 G-9 IMG 24 DEC 07358 09:00:00 -90 5 4
88 G-9 IMG 24 DEC 07358 12:00:00 -90 5 4
89 G-9 IMG 24 DEC 07358 15:00:00 -90 5 4
90 G-9 IMG 24 DEC 07358 21:00:00 -90 5 4
91 G-9 IMG 25 DEC 07359 00:00:00 -90 5 4
92 G-9 IMG 25 DEC 07359 12:00:00 -90 5 4
93 G-9 IMG 25 DEC 07359 15:00:00 -90 5 4
94 G-9 IMG 25 DEC 07359 21:00:00 -90 5 4
95 G-9 IMG 26 DEC 07360 03:00:00 -90 5 4
96 G-9 IMG 26 DEC 07360 21:00:00 -90 5 4
97 G-9 IMG 27 DEC 07361 06:00:00 -90 5 4
98 G-9 IMG 27 DEC 07361 09:00:00 -90 5 4
99 G-9 IMG 27 DEC 07361 15:00:00 -90 5 4
100 G-9 IMG 27 DEC 07361 21:00:00 -90 5 4
101 G-9 IMG 29 DEC 07363 03:00:00 -90 5 4
102 G-9 IMG 29 DEC 07363 09:00:00 -90 5 4
103 G-9 IMG 29 DEC 07363 12:00:00 -90 5 4
104 G-9 IMG 29 DEC 07363 18:00:00 -90 5 4
105 G-9 IMG 29 DEC 07363 21:00:00 -90 5 4
106 G-9 IMG 30 DEC 07364 03:00:00 -90 5 4
107 G-9 IMG 30 DEC 07364 09:00:00 -90 5 4
108 G-9 IMG 30 DEC 07364 15:00:00 -90 5 4
109 G-9 IMG 31 DEC 07365 00:00:00 -90 5 4
110 G-9 IMG 31 DEC 07365 15:00:00 -90 5 4
111 G-9 IMG 1 JAN 08001 03:00:00 -90 5 4
112 G-9 IMG 2 JAN 08002 09:00:00 -90 5 4
113 G-9 IMG 3 JAN 08003 00:00:00 -90 5 4
114 G-9 IMG 4 JAN 08004 18:00:00 -90 5 4
115 G-9 IMG 5 JAN 08005 03:00:00 -90 5 4
116 G-9 IMG 5 JAN 08005 18:00:00 -90 5 4
117 G-9 IMG 6 JAN 08006 03:00:00 -90 5 4
118 G-9 IMG 7 JAN 08007 03:00:00 -90 5 4
119 G-9 IMG 7 JAN 08007 12:00:00 -90 5 4
120 G-9 IMG 8 JAN 08008 00:00:00 -90 5 4
121 G-9 IMG 8 JAN 08008 09:00:00 -90 5 4
122 G-9 IMG 8 JAN 08008 12:00:00 -90 5 4
123 G-9 IMG 9 JAN 08009 03:00:00 -90 5 4
124 G-9 IMG 10 JAN 08010 12:00:00 -90 5 4
125 G-9 IMG 10 JAN 08010 15:00:00 -90 5 4
126 G-9 IMG 10 JAN 08010 18:00:00 -90 5 4
127 G-9 IMG 10 JAN 08010 21:00:00 -90 5 4
128 G-9 IMG 11 JAN 08011 09:00:00 -90 5 4
129 G-9 IMG 12 JAN 08012 15:00:00 -90 5 4
130 G-9 IMG 13 JAN 08013 03:00:00 -90 5 4
131 G-9 IMG 14 JAN 08014 03:00:00 -90 5 4
132 G-9 IMG 14 JAN 08014 21:00:00 -90 5 4
133 G-9 IMG 15 JAN 08015 03:00:00 -90 5 4
134 G-9 IMG 15 JAN 08015 06:00:00 -90 5 4
135 G-9 IMG 16 JAN 08016 09:00:00 -90 5 4
136 G-9 IMG 16 JAN 08016 21:00:00 -90 5 4
137 G-9 IMG 18 JAN 08018 09:00:00 -90 5 4
138 G-9 IMG 18 JAN 08018 21:00:00 -90 5 4
139 G-9 IMG 19 JAN 08019 03:00:00 -90 5 4
140 G-9 IMG 19 JAN 08019 09:00:00 -90 5 4
141 G-9 IMG 19 JAN 08019 21:00:00 -90 5 4
142 G-9 IMG 20 JAN 08020 00:00:00 -90 5 4
143 G-9 IMG 20 JAN 08020 21:00:00 -90 5 4
144 G-9 IMG 21 JAN 08021 00:00:00 -90 5 4
145 G-9 IMG 21 JAN 08021 12:00:00 -90 5 4
146 G-9 IMG 22 JAN 08022 03:00:00 -90 5 4
147 G-9 IMG 22 JAN 08022 18:00:00 -90 5 4
148 G-9 IMG 23 JAN 08023 00:00:00 -90 5 4
149 G-9 IMG 23 JAN 08023 03:00:00 -90 5 4
150 G-9 IMG 23 JAN 08023 09:00:00 -90 5 4
151 G-9 IMG 23 JAN 08023 15:00:00 -90 5 4
152 G-9 IMG 24 JAN 08024 00:00:00 -90 5 4
153 G-9 IMG 24 JAN 08024 15:00:00 -90 5 4
154 G-9 IMG 25 JAN 08025 03:00:00 -90 5 4
155 G-9 IMG 25 JAN 08025 12:00:00 -90 5 4
156 G-9 IMG 25 JAN 08025 15:00:00 -90 5 4
157 G-9 IMG 26 JAN 08026 09:00:00 -90 5 4
158 G-9 IMG 26 JAN 08026 15:00:00 -90 5 4
159 G-9 IMG 27 JAN 08027 03:00:00 -90 5 4
160 G-9 IMG 27 JAN 08027 12:00:00 -90 5 4
161 G-9 IMG 27 JAN 08027 15:00:00 -90 5 4
162 G-9 IMG 27 JAN 08027 21:00:00 -90 5 4
163 G-9 IMG 28 JAN 08028 03:00:00 -90 5 4
164 G-9 IMG 28 JAN 08028 21:00:00 -90 5 4
165 G-9 IMG 29 JAN 08029 06:00:00 -90 5 4
166 G-9 IMG 29 JAN 08029 09:00:00 -90 5 4
167 G-9 IMG 29 JAN 08029 12:00:00 -90 5 4
168 G-9 IMG 29 JAN 08029 15:00:00 -90 5 4
169 G-9 IMG 29 JAN 08029 21:00:00 -90 5 4
170 G-9 IMG 30 JAN 08030 03:00:00 -90 5 4
171 G-9 IMG 30 JAN 08030 15:00:00 -90 5 4
172 G-9 IMG 30 JAN 08030 21:00:00 -90 5 4
173 G-9 IMG 31 JAN 08031 09:00:00 -90 5 4
174 G-9 IMG 31 JAN 08031 15:00:00 -90 5 4
175 G-9 IMG 31 JAN 08031 21:00:00 -90 5 4
176 G-9 IMG 1 FEB 08032 00:00:00 -90 5 4
177 G-9 IMG 1 FEB 08032 09:00:00 -90 5 4
178 G-9 IMG 1 FEB 08032 12:00:00 -90 5 4
179 G-9 IMG 2 FEB 08033 03:00:00 -90 5 4
180 G-9 IMG 2 FEB 08033 15:00:00 -90 5 4
181 G-9 IMG 3 FEB 08034 03:00:00 -90 5 4
182 G-9 IMG 3 FEB 08034 06:00:00 -90 5 4
183 G-9 IMG 3 FEB 08034 15:00:00 -90 5 4
184 G-9 IMG 3 FEB 08034 21:00:00 -90 5 4
185 G-9 IMG 4 FEB 08035 03:00:00 -90 5 4
186 G-9 IMG 4 FEB 08035 09:00:00 -90 5 4
187 G-9 IMG 4 FEB 08035 15:00:00 -90 5 4
188 G-9 IMG 4 FEB 08035 21:00:00 -90 5 4
189 G-9 IMG 5 FEB 08036 03:00:00 -90 5 4
190 G-9 IMG 5 FEB 08036 09:00:00 -90 5 4
191 G-9 IMG 5 FEB 08036 15:00:00 -90 5 4
192 G-9 IMG 6 FEB 08037 03:00:00 -90 5 4
193 G-9 IMG 6 FEB 08037 09:00:00 -90 5 4
194 G-9 IMG 6 FEB 08037 15:00:00 -90 5 4
195 G-9 IMG 6 FEB 08037 18:00:00 -90 5 4
196 G-9 IMG 6 FEB 08037 21:00:00 -90 5 4
IMGLIST: done
Next question: why are current Antarctic IR images not being received
and/or processed?
The 'pqact' action for processing these images looks correct:
~ldm/etc/pqact.conf_mcidasB
...
# UW Antarctic IR composite
UNIWISC ^pnga2area Q. (U1) (.*) (.*)_IMG (.*) (.*) (........) (....)
PIPE -close util/ldmfile.sh
/data/ldm/mcidas/images/sat/ANTARCTIC/\5/IR/\6/IR_\6_\7
...
Apparently, no UNIWISC Antarctic IR images have been received today?
While looking around to figure out why no Antarctic images have been
processed today, I noticed that there multiple 'pqact' exits. Here
is one example of this indication from the LDM log file:
Feb 07 19:14:37 shu pqact[568] ERROR: Couldn't exec(xcd_run): No such file or
directory
Feb 07 19:14:37 shu pqact[19677] NOTE: Exiting
I took a look at the McIDAS XCD execution script, xcd_run, to see if anything
looked amiss. The only thing I found was that the location of the XCD log
file was specified incorrectly: it was set for /usr/local/ldm/logs when the
LDM is installed in /home/ldm on your system. I changed the location in
~ldm/decoders/xcd_run and then restarted your LDM. Now McIDAS XCD decoders
are running again.
While looking in the LDM log file for the reason that 'pqact's were exiting, I
noticed the following:
Feb 07 19:14:37 shu pqact[567] NOTE: Behind by 4664.91 s
This tells us that your machine is 4664 seconds behind in processing products
out of your LDM queue. A quick check to see the age of the oldest product
in your queue:
<as 'ldm'>
[ldm@shu ~]$ pqmon -l-
Feb 07 19:23:33 pqmon NOTE: Starting Up (3483)
Feb 07 19:23:33 pqmon NOTE: nprods nfree nempty nbytes maxprods maxfree
minempty maxext age
Feb 07 19:23:33 pqmon NOTE: 78177 97 165866 681958736 165662 1436
78477 17982616 4929
Feb 07 19:23:33 pqmon NOTE: Exiting
shows that your machine is extremely bound up in its processing: the age of the
oldest product is 4929 seconds, and your processing is 4664 seconds behind.
This
is the reason for the missing products you reported previously! Being bound up
is
also one part of the reason that ADDE serving of data off of your machine is so
slow;
the other part is that your datasets have a LOT of images in them, so it takes a
long time to index them for each ADDE image transaction!
As I surmised previously, your machine only has 1.5 GB of memory. I also see
that
your LDM queue is 1 GB in size. The size of your queue in relation to the
amount
of RAM you have is within the reasonable range.
The size of your queue in relation to the speed for which you can process the
data
you are receiving, however, is not enough to process all of the data you are
receiving. My recommendation, therefore, is to do some or all of the following:
- increase the amount of memory in your system
- split your data processing across two or more independent file systems
(right now you are processing everything into the single file system that
holds /data
- cut down on the volume of data
Adding memory should allow you to increase your LDM queue size.
Splitting the processing (writes) across two or more disks would help cut
down the I/O waits you are seeing (run 'top' for awhile and watch the high
I/O waits).
Cutting down on the volume of data you are ingesting would help to keep
your system from thrashing.
As a reminder, you are currently ingesting the following
IDD datastreams of model data: all of HRS (via the UNIDATA compound feed:
UNIDATA==HRS|IDS|DDPLUS|UNIWISC), all of GEM, and some of CONDUIT.
As far as accessing imagery data using ADDE, I recommend that you continue
on the path of organizing images of a single type into daily directories
and then adjusting your ADDE dataset definitions to access the current
day's data for each image type. This will result in much fewer images
being examined each time an ADDE request is made, so the waits should
drop dramatically.
Please let me know if you have questions on the things I found...
Cheers,
Tom
****************************************************************************
Unidata User Support UCAR Unidata Program
(303) 497-8642 P.O. Box 3000
address@hidden Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage http://www.unidata.ucar.edu
****************************************************************************
Ticket Details
===================
Ticket ID: TTR-495389
Department: Support McIDAS
Priority: Normal
Status: Closed
