[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: occasional weird timestamps and bad data with THREDDS



John, thanks for the reply

On Wed, Mar 30, 2011 at 11:12 AM, John Caron <address@hidden> wrote:
> Hi Tom:
>
> 1) what version TDS?

Version 4.2.1 - 20101201.2028

> 2) is this an aggregaton? (you can send me the config catalog)
yes, threddsConfig.xml & catalog.xml attached, let me know if you want
more (we have an enhancedCatalog.xml and wmsConfig.xml too)


> 3) are there errors in threddsServlet.log?
yes, I've attached a text file with the errors from the logs

> 4) when you "update the netcdf files multiple times over 5-6 hours ", do you
> overwrite? extend?

I believe the the files are always overwritten.  I'll double check and
get back to you if I'm wrong.


THANKS
Tom
>
> its hard when its intermittent, we may have to figure out how to
> consistently reproduce.
>
> john
>
> On 3/30/2011 11:21 AM, tom cook wrote:
>>
>> HI John,
>> I have been tasked with maintaining the HF Radar national network
>> THREDDS server here at SIO. Rich has helped us set things up, and has
>> been a valuable resource for learning this system. We have been having
>> a frequent problem that Rich has been unable to help us with, which is
>> occasional bad timestamps and occasional bad data served through
>> THREDDS.
>> An example of bad data being served through THREDDS: we are working
>> with ASA&  USCG to get data into their SAROPS product. They have
>> complained that many of the data samples have had data in the wrong
>> geographical location (ie ocean currents over land). I have noticed
>> this as well using the Godiva viewer, and when I compare the Godiva
>> map with the source netcdf file, it is not plotting the data in the
>> correct location. This makes me think it is a problem with the data
>> being served by THREDDS. The problem goes away after some time, as we
>> typically update the netcdf files multiple times over 5-6 hours after
>> they are created. I'm not sure if the updating of the netcdf files is
>> the cause of the problem, but it is not something that is easy to
>> reproduce.
>>
>> The problem we have with weird timestamps happens occasionally, and in
>> random locations throughout the time index. It usually is just one
>> sample here or there, and not successive samples. It almost always
>> goes away when I empty the cache.
>>
>> I'm not sure if these issues are setup related, or issues we can
>> script some workarounds to help. But I wanted to check with you to see
>> if you have any idea of what is going on.
>>
>> Thanks for your time,
>>
>> Tom Cook
>> Programmer/Analyst
>> Coastal Observation Research&  Development Center
>> Scripps Institution of Oceanography
>
>
logs/threddsServlet.log.2010-11-15-21:2010-11-15T21:17:17.707 +0000 [     
37423][      41] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-RTV
logs/threddsServlet.log.2010-11-15-21:2010-11-15T21:25:04.694 +0000 [    
504410][      94] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-RTV
logs/threddsServlet.log.2010-11-15-22:2010-11-15T22:19:21.420 +0000 [   
3761136][     199] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-RTV
logs/threddsServlet.log.2010-11-16-02:2010-11-16T02:00:37.800 +0000 [  
17037516][     216] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-GNOME
logs/threddsServlet.log.2010-11-16-03:2010-11-16T03:34:49.099 +0000 [  
22688815][     224] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-05:2010-11-16T05:32:43.237 +0000 [  
29762953][     240] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-05:2010-11-16T05:45:03.182 +0000 [  
30502898][     244] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:14:59.060 +0000 [  
32298776][     249] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:30:00.566 +0000 [  
33200282][     307] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:39:12.856 +0000 [  
33752572][     309] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:49:45.137 +0000 [  
34384853][     314] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:59:06.228 +0000 [  
34945944][     333] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:12:38.820 +0000 [  
35758536][     324] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.showForm
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:12:38.822 +0000 [  
35758538][     324] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-RTV
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:19:54.663 +0000 [  
36194379][     357] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-RTV
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:26:29.727 +0000 [  
36589443][     364] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:29:57.166 +0000 [  
36796882][     370] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:48:55.340 +0000 [  
37935056][     375] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-RTV
logs/threddsServlet.log.2010-11-16-11:2010-11-16T11:22:48.866 +0000 [  
50768582][     427] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-RTV
logs/threddsServlet.log.2010-11-16-12:2010-11-16T12:42:02.937 +0000 [  
55522653][     455] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:21:34.659 +0000 [  
72294375][     823] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-RTV
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:21:35.717 +0000 [  
72295433][     824] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:10.892 +0000 [  
72330608][     826] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:42.215 +0000 [  
72361931][     829] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:43.701 +0000 [  
72363417][     832] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-RTV
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:45.562 +0000 [  
72365278][     836] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-19:2010-11-16T19:28:20.604 +0000 [  
79900320][     873] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:20:54.692 +0000 [    
319028][      11] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-RTV
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:21:15.555 +0000 [    
339891][       9] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:21:15.555 +0000 [    
339891][      10] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:24:56.414 +0000 [    
560750][      19] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:24:56.414 +0000 [    
560750][      18] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:02.643 +0000 [    
566979][      50] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:05.196 +0000 [    
569532][      56] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:12.570 +0000 [    
576906][      66] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:23.275 +0000 [    
587611][      75] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:27:51.000 +0000 [    
735336][     101] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:28:21.875 +0000 [    
766211][      87] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:28:47.717 +0000 [    
792053][     110] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:29:33.779 +0000 [    
838115][     120] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:29:36.283 +0000 [    
840619][     131] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:29:36.283 +0000 [    
840619][     132] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-01:2010-12-13T01:29:48.978 +0000 [   
4453314][     196] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-RTV
logs/threddsServlet.log.2010-12-13-02:2010-12-13T02:20:05.468 +0000 [   
7469804][     296] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-02:2010-12-13T02:56:18.721 +0000 [   
9643057][     412] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-RTV
logs/threddsServlet.log.2010-12-13-03:2010-12-13T03:28:45.316 +0000 [  
11589652][     444] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-04:2010-12-13T04:51:13.162 +0000 [  
16537498][     586] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-05:2010-12-13T05:26:41.677 +0000 [  
18666013][     613] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-RTV
logs/threddsServlet.log.2010-12-13-05:2010-12-13T05:41:44.124 +0000 [  
19568460][     658] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-08:2010-12-13T08:03:12.248 +0000 [  
28056584][     868] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-08:2010-12-13T08:23:20.508 +0000 [  
29264844][     888] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:08:06.544 +0000 [  
49950880][    1595] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:36:11.738 +0000 [  
51636074][    1677] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:36:34.765 +0000 [  
51659101][    1702] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:52:23.635 +0000 [  
52607971][    1705] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-GNOME
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:17:15.990 +0000 
[4928500326][  193926] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/2073744616-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:18:14.220 +0000 
[4928558556][  193928] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1040000942-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:25:52.732 +0000 
[4929017068][  193936] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1896543939-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:26:09.295 +0000 
[4929033631][  193937] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-780569033-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:28:22.174 +0000 
[4929166510][  193942] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-800759866-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:30:59.319 +0000 
[4929323655][  193959] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-1728976716-RTV.nc
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:46:20.593 +0000 
[5095844929][  200860] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-415350283-GNOME.nc
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:46:30.859 +0000 
[5095855195][  200861] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1505331550-GNOME.nc
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:48:40.748 +0000 
[5095985084][  200865] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:48:40.811 +0000 
[5095985147][  200865] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-17-18:2011-02-17T18:50:42.373 +0000 
[5769306709][  232655] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  synch failed on HFRNet/USEGC/2km/hourly/GNOME 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021900_HFRadar_USEGC_2km_rtv_SIO.nc
 (No such file or directory)
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.009 +0000 
[5769973345][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909011500_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.010 +0000 
[5769973346][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909011600_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.010 +0000 
[5769973346][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021700_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.010 +0000 
[5769973346][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021100_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.011 +0000 
[5769973347][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021800_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-22:2011-02-17T22:42:22.114 +0000 
[5783206450][  233214] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/364212374-RTV.nc
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:38.652 +0000 
[5787902988][  233382] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:38.694 +0000 
[5787903030][  233382] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:54.530 +0000 
[5787918866][  233383] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:54.532 +0000 
[5787918868][  233383] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:01:02.589 +0000 
[5787926925][  233384] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:01:02.654 +0000 
[5787926990][  233384] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:08:50.985 +0000 
[5788395321][  233412] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-630672552-RTV.nc
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:09:02.474 +0000 
[5788406810][  233415] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-525789344-RTV.nc
logs/threddsServlet.log.2011-02-24-18:2011-02-24T18:47:56.816 +0000 
[6373941152][  256564] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-2007368388-GNOME.nc
logs/threddsServlet.log.2011-02-24-18:2011-02-24T18:48:12.381 +0000 
[6373956717][  256565] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/703218262-GNOME.nc
logs/threddsServlet.log.2011-03-03-21:2011-03-03T21:41:33.480 +0000 
[6989157816][  280646] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1917002746-RTV.nc
logs/threddsServlet.log.2011-03-03-21:2011-03-03T21:42:47.000 +0000 
[6989231336][  280647] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-1356197353-RTV.nc
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:33:17.426 +0000 [    
231865][       9] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:42:45.480 +0000 [    
799919][      23] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:43:39.757 +0000 [    
854196][      28] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:44:24.543 +0000 [    
898982][      33] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:45:02.112 +0000 [    
936551][      38] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:51:54.821 +0000 [   
1349260][      44] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:57:36.256 +0000 [   
1690695][      45] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:57:42.553 +0000 [   
1696992][      47] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-18:2011-03-08T18:00:30.352 +0000 [   
1864791][      56] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-18:2011-03-08T18:03:37.975 +0000 [   
2052414][      63] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-18:2011-03-08T18:05:31.503 +0000 [   
2165942][      64] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-19:2011-03-08T19:22:28.522 +0000 [   
6782961][     227] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-20:2011-03-08T20:43:21.443 +0000 [  
11635882][     378] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:08:26.251 +0000 [  
13140690][     452] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:09:43.658 +0000 [  
13218097][     453] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:09:50.605 +0000 [  
13225044][     454] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:10:06.784 +0000 [  
13241223][     456] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:11:53.712 +0000 [  
13348151][     457] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:12:05.555 +0000 [  
13359994][     511] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:12:08.081 +0000 [  
13362520][     512] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:13:10.035 +0000 [  
13424474][     554] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:13:51.128 +0000 [  
13465567][     558] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:33:46.437 +0000 [  
14660876][     607] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:33:56.280 +0000 [  
14670719][     611] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:41:02.499 +0000 [  
15096938][     656] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:41:21.494 +0000 [  
15115933][     661] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-RTV
logs/threddsServlet.log.2011-03-14-18:2011-03-14T18:00:12.762 +0000 [ 
520247201][   18265] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/193329828-RTV.nc
logs/threddsServlet.log.2011-03-14-18:2011-03-14T18:00:17.807 +0000 [ 
520252246][   18266] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-613858041-RTV.nc
logs/threddsServlet.log.2011-03-14-18:2011-03-14T18:00:35.486 +0000 [ 
520269925][   18267] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-1336016402-RTV.nc
<?xml version="1.0" encoding="UTF-8"?>
<catalog name="HFRNET Top Catalog"
        xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
        xmlns:xlink="http://www.w3.org/1999/xlink";>

  <dataset name="HF RADAR RTVs">
    <catalogRef xlink:title="HF RADAR, Alaska, North Slope" 
xlink:href="HFRADAR_AKNS_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US West Coast" 
xlink:href="HFRADAR_USWC_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US East and Gulf Coast" 
xlink:href="HFRADAR_USEGC_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US Hawai'i State" 
xlink:href="HFRADAR_USHI_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, Puerto Rico and the US Virgin Islands" 
xlink:href="HFRADAR_PRVI_hourly_RTV.xml" name=""/>
  </dataset>

  <dataset name="HF RADAR RTVs (GNOME Format)">
    <catalogRef xlink:title="HF RADAR, Alaska, North Slope (GNOME Format)" 
xlink:href="HFRADAR_AKNS_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US West Coast (GNOME Format)" 
xlink:href="HFRADAR_USWC_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US East and Gulf Coast (GNOME Format)" 
xlink:href="HFRADAR_USEGC_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US Hawai'i State (GNOME Format)" 
xlink:href="HFRADAR_USHI_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, Puerto Rico and the US Virgin Islands 
(GNOME Format)" xlink:href="HFRADAR_PRVI_hourly_GNOME.xml" name=""/>
  </dataset>

</catalog>
<?xml version="1.0" encoding="UTF-8"?>
<threddsConfig>



  <!-- all options are commented out in standard install - meaning use default 
values -->
  <!-- see 
http://www.unidata.ucar.edu/projects/THREDDS/tech/reference/ThreddsConfigXMLFile.html
 -->
  <serverInformation>
    <name>CORDC Production TDS</name>
    <logoUrl>thredds.png</logoUrl>
    <logoAltText>CORDC Production TDS</logoAltText>

    <abstract>Scientific Data</abstract>
    <keywords>climate, ocean, earth science, ocean currents, HF radar</keywords>
    
    <contact>
      <name>Tom Cook</name>
      <organization>CORDC</organization>
      <email>address@hidden</email>
      <!--phone></phone-->
    </contact>
    <hostInstitution>
      <name>Coastal Observing Research and Development Center, Scripps 
Institution of Oceanography</name>
      <webSite>http://cordc.ucsd.edu</webSite>
      <logoUrl>web_bw_thmb.gif</logoUrl>
      <logoAltText>CORDC/SIO</logoAltText>
    </hostInstitution>
  </serverInformation>

  <!--
  The <catalogRoot> element:
  For catalogs you don't want visible from the /thredds/catalog.xml chain
  of catalogs, you can use catalogRoot elements. Each catalog root config
  catalog is crawled and used in configuring the TDS.
  -->

  <catalogRoot>all.xml</catalogRoot>

  <!--
   * Setup for generated HTML pages.
   *
   * NOTE: URLs may be absolute or relative, relative URLs must be relative
   * to the webapp URL, i.e., http://server:port/thredds/.
    -->
  <htmlSetup>
    <!--
     * CSS documents used in generated HTML pages.
     * The CSS document given in the "catalogCssUrl" element is used for all 
pages
     * that are HTML catalog views. The CSS document given in the 
"standardCssUrl"
     * element is used in all other generated HTML pages.
     * -->
    <standardCssUrl>tds.css</standardCssUrl>
    <catalogCssUrl>tdsCat.css</catalogCssUrl>

    <!--
     * The URLs (relative to "/thredds/") and alternate text for both
     * folder and dataset icons used in HTML catalog views.
     * -->
    <folderIconUrl>folder.gif</folderIconUrl>
    <folderIconAlt>Folder</folderIconAlt>
    <datasetIconUrl>dataset.gif</datasetIconUrl> <!-- Not currently used. -->
    <datasetIconAlt>Dataset</datasetIconAlt>     <!-- Not currently used. -->

  </htmlSetup>

  <!--
   The <CatalogServices> element:
   - Services on local TDS served catalogs are always on.
   - Services on remote catalogs are set with the allowRemote element
   below. They are off by default (recommended).
   -->
  <CatalogServices>
    <allowRemote>false</allowRemote>
  </CatalogServices>

  <!--
  Configuring the CDM (netcdf-java library)
  see 
http://www.unidata.ucar.edu/software/netcdf-java/reference/RuntimeLoading.html

  <nj22Config
    <ioServiceProvider class="edu.univ.ny.stuff.FooFiles"/>
    <coordSysBuilder convention="foo" class="test.Foo"/>
    <coordTransBuilder name="atmos_ln_sigma_coordinates" type="vertical" 
class="my.stuff.atmosSigmaLog"/>
    <typedDatasetFactory datatype="Point" 
class="gov.noaa.obscure.file.Flabulate"/>
    <table type="GRIB1" filename="/home/rkambic/grib/tables/userlookup.lst"/>
    <table type="GRIB2" 
filename="/home/rkambic/grib/tables/grib2userparameters"/>
  </nj22Config>
  -->

  <!--
  CDM uses the DiskCache directory to store temporary files, like uncompressed 
files.
  <DiskCache>
    <alwaysUse>false</alwaysUse>
    <dir>/data/tmp/thredds/cache/</dir>
    <scour>1 hour</scour>
    <maxSize>1 Gb</maxSize>
  </DiskCache>
  -->

  <!--
  Caching open NetcdfFile objects.
  default is to allow 200 - 400 open files, cleanup every 10 minutes
  <NetcdfFileCache>
    <minFiles>200</minFiles>
    <maxFiles>400</maxFiles>
    <scour>10 min</scour>
  </NetcdfFileCache>
  -->

  <!--
  Caching open NetcdfDataset objects.
   default allow 100 - 200 open datasets, cleanup every 10 minutes
  <NetcdfDatasetCache>
    <minFiles>100</minFiles>
    <maxFiles>200</maxFiles>
    <scour>10 min</scour>
  </NetcdfDatasetCache>
  -->

  <!--
  The <HTTPFileCache> element:
  allow 20 - 40 open datasets, cleanup every 10 minutes
  used by HTTP Range requests.
  <HTTPFileCache>
    <minFiles>20</minFiles>
    <maxFiles>40</maxFiles>
    <scour>10 min</scour>
  </HTTPFileCache>
  -->

  <!--
  Writing GRIB indexes.
  <GribIndexing>
    <setExtendIndex>false</setExtendIndex>
    <alwaysUseCache>false</alwaysUseCache>
  </GribIndexing>
  -->

  <!--
  Persist joinNew aggregations to named directory. scour every 24 hours, delete 
stuff older than 30 days
  <AggregationCache>
    <dir>/data/tmp/thredds/aggcache/</dir>
    <scour>24 hours</scour>
    <maxAge>30 days</maxAge>
  </AggregationCache>
  -->

  <!--
  How to choose the template dataset for an aggregation. latest, random, or 
penultimate
  -->
  <Aggregation>
    <typicalDataset>penultimate</typicalDataset>
  </Aggregation>

  <!--
  The Netcdf Subset Service is off by default.
  -->
  <NetcdfSubsetService>
    <allow>true</allow>
    <dir>/data/tmp/thredds/ncSubsetCache/</dir>
    <scour>10 min</scour>
    <maxAge>-1 min</maxAge>
    <metarDataDir>/opt/tomcat/content/thredds/public/stn/</metarDataDir>
    <metarRawDir>/data/ldm/pub/decoded/netcdf/surface/metar/</metarRawDir>
  </NetcdfSubsetService>

  <!--
  <Opendap>
    <ascLimit>50</ascLimit>
    <binLimit>500</binLimit>
    <serverVersion>opendap/3.7</serverVersion>
  </Opendap>
    -->
  
  <!--
  The WCS Service is off by default.
  Also, off by default (and encouraged) is operating on a remote dataset.
  -->
  <WCS>
    <allow>true</allow>
    <allowRemote>false</allowRemote>
    <dir>/data/tmp/thredds/wcsCache/</dir>
    <scour>15 min</scour>
    <maxAge>30 min</maxAge>
  </WCS>

  <WMS>
    <allow>true</allow>
    <allowRemote>false</allowRemote>
    <dir>/data/tmp/thredds/wmsCache/</dir>
    <maxImageWidth>2048</maxImageWidth>
    <maxImageHeight>2048</maxImageHeight>
  </WMS>


  <!-- CatalogGen service is off by default.
  <CatalogGen>
    <allow>false</allow>
  </CatalogGen>
   -->

  <!-- DLwriter service is off by default.
       As is support for operating on remote catalogs.
  <DLwriter>
    <allow>false</allow>
    <allowRemote>false</allowRemote>
  </DLwriter>
   -->

  <!-- DqcService is off by default.
  <DqcService>
    <allow>false</allow>
  </DqcService>
   -->

  <!--
   Link to a Viewer application on the HTML page:
   <Viewer>my.package.MyViewer</Viewer>
   -->

   <!--
   Add a DataSource - essentially an IOSP with access to Servlet request 
parameters
   <DatsetSource>my.package.DatsetSourceImpl</DatsetSource>
   -->

  <!--
  Forecast Model Run Collection Inventory
  <FmrcInventory>
    <openType>XML_ONLY</openType>
  </FmrcInventory>
  -->

  <!--
  Modify Logging parameters. Normally use log4j.xml
  <Logging>
    <DatePattern></DatePattern>
    <MaxFileSize></MaxFileSize>
    <MaxFiles></MaxFiles>
  </Logging>
  -->

</threddsConfig>

NOTE: All email exchanges with Unidata User Support are recorded in the Unidata inquiry tracking system and then made publicly available through the web. If you do not want to have your interactions made available in this way, you must let us know in each email you send to us.