Re: [thredds] Trouble with TDS accessing data

  • To: Dennis Heimbigner <dmh@xxxxxxxx>, "thredds@xxxxxxxxxxxxxxxx" <thredds@xxxxxxxxxxxxxxxx>
  • Subject: Re: [thredds] Trouble with TDS accessing data
  • From: "Brown, Mitchell E (Mitch) CIV USARMY CEERD-CHL (USA)" <Mitchell.E.Brown@xxxxxxxxxxxxxx>
  • Date: Wed, 28 Jun 2023 21:44:17 +0000
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=usace.army.mil; dmarc=pass action=none header.from=usace.army.mil; dkim=pass header.d=usace.army.mil; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector5501; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fXg9sd4i2Suty9aBpzpN4B4TRYfaQ4FlSSHcpgH3+lY=; b=lo1bEBI7JFqD8jjWQItl6P4C8qRvVSTgi9EIx88XL0ha4SnfcAhBQfjzMXicdwPSSTCvutm+xvpBqgMQD/CNDEKwKhnswB6wREHFnYQX11rdnd727A28XQD76jA+gkcmAtddNgzAsnaqpd8PGhZQ0yXiiNDNkAn7X7zcovt0GN6yYTzOIGiw5bqQaLes3qhbXAKRBv7ruVGqdJVdHdtGG/NIO3YMv3jSdesh2iRVEJaRYPfKurBZAsFBrdPkPG2QYa4/pk4ZNrcq2FJPeRCZbZEWJ6s/zgBDey5MP4rMP7tkAcKGb/uHbzhjJzfOg4OyMdZrtig29ZucYzlePKcvtg==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector5501; d=microsoft.com; cv=none; b=XyZoSKBP7x2iyLRFuBCAtWZQ/NGCRuDcCpHbJRTb3SosOYgg3DTgJWPWDiLo1YQlLNli0XOIH7hfnVsLwTGjxoYcGUpUkUimx5fFfR0UX2WbGR6lNWjoq1D7oxPVRg/bdZ3CD/55Wrlqf6wIIG+XggTWaeFYbqvHsgpYwADLhTQdOB0vDbMCFrxyIxOCFpBEFrPhHPJx9GP4aKDi50MiUBIGGSfHpsahZJrNSGEm/F76iYXBE8mie1AvXzDli+QsYVIT0pmmQCUW743Ru6Vikdtll25ygtfKIzAmGJGtdWxnRzPgn3gyH7jeChoQ06zccIhysII4NKffOycx8tcu+Q==
  • Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=usace.army.mil;
  • Ironport-data: A9a23:xzmL7quUWau3W8F8nDeTiRlB+OfnVOVcMUV32f8akzHdYApBsoF/q tZmKTqEOquJNmWjethwOou2oUkPu5eByYNqTANq+HhmFC4S9ZOVVN+UEBz9bniYRiHhoOOLz Cm8hv3odp1coqr0/0/1WlTZhSAgk/vOH9IQMcacUghpXwhoVSw9vhxqnu89k+ZAjMOwa++3k YuaT/b3Zhn9glaYDkpOs/jY8E017Kyp0N8llgRWic5j7Qe2e0Y9Ucp3yZGZdxPQXoRSF+imc OfPpJnRErTxon/Bovv8+lrKWhViroz6ZGBiuVIPM0SWuSWukwRpukoN2FrwXm8M49mBt4gZJ NygLvVcQy9xVkHHsLx1vxW1j0iSMIUekIIrL0RTvuSx9hHteGT++sxSEV9qYbI04sYnAnB3o KlwxDAlNnhvhsq53+n9V/JljcllJdPuLcUau3UIITPxVK15B8mdGuOQuIMehm5v7ixNNa+2i 84xTDtzZxTNZxkJFxE9EpUhms+1nXD0fntRsleE46825wA/ySQsiOW9boKMIIziqcN9rkGyo Gb+uFrFHAATEPW8z2vdyXS1mbqa9c/8cMdIfFGizdZ2gEeeymAIIAAQVFeyvfD/l0W3QZRSJ 1F8x8Y1hactrwq2VdD2UluxunuV+BsdX7K8DtEH1e1E8YKMiy7xO4TOZmQphAAO3CPueQEX6 w==
  • Ironport-hdrordr: A9a23:ALTqn6Ea0dVHLgfUpLqEhseALOsnbusQ8zAXPiFKKCC9Hfbzqy nDpp8mPHzP5gr5JktNpTnoAsDpfZq2z/NICOcqUoufYA==
Sorry for the delay in my reply.  I think the issue must have been somewhere on 
our side with the Tomcat, Nginx, or Web proxy because we had all sorts of 
issues earlier this week, and none of the issues seem to be evident today. My 
guess is our network/linux team made some change that broke things sporadically 
and have since fixed the issue.

All seems to working as expected at the moment. Thanks again,

Mitchell Brown
Coastal and Hydraulics Laboratory, ERDC
US Army Corps of Engineers

-----Original Message-----
From: thredds <thredds-bounces@xxxxxxxxxxxxxxxx> On Behalf Of Dennis Heimbigner
Sent: Tuesday, June 27, 2023 12:46 PM
To: Brown, Mitchell E (Mitch) CIV USARMY CEERD-CHL (USA) 
<Mitchell.E.Brown@xxxxxxxxxxxxxx>; thredds@xxxxxxxxxxxxxxxx
Subject: Re: [thredds] Trouble with TDS accessing data

Could you send a complete URL for one of the datasets?
=Dennis Heimbigner
   Unidata

On 6/26/2023 11:00 AM, Brown, Mitchell E (Mitch) CIV USARMY CEERD-CHL
(USA) wrote:
>
> TDS Team,
>
> We have a production TDS system that has been running for a long while
> (~5 years) that accesses data for a collection of stations around the 
> US (~41 years of hourly data for many variables per station).  When 
> trying to use TDS’ OpenDAP option to retrieve any record with 
> time-varying data some stations, we get a message back with an error 
> message (the variables with only one value work fine). The message we 
> get is vague (see below).
>
> Dataset {
>     Float64 waveSpreadWindsea[time = 744];
> } wis/Pacific/ST81512/1981/WIS-ocean_waves_ST81512_198103.nc;
> ---------------------------------------------
> Error {
>     code = 500;
>     message = "null";
> };
>
> TDS can see there are 744 records (hourly data for one month), yet 
> cannot retrieve and send that data back. I have downloaded the NetCDF 
> file for this month and have been able to use other tools (HDFView, R, 
> and Python) to read the file contents with no issues, yet Thredds is 
> unable to retrieve that data.
>
> For a station immediately adjacent to this location, TDS works 
> completely fine in retrieving using OpenDAP.  The file sizes for each 
> station is reasonably similar, so it’s not like the data is not 
> written correctly.
>
> Here are a couple of links that can be used as references for 
> “working” and “not working” in TDS.
>
> Working:
>
> //chldata.erdc.dren.mil/thredds/dodsC/wis/Pacific/ST81512/1981/WIS-oce
> an_waves_ST81512_198103.nc.ascii?waveSpreadWindsea%5B0:1:743%5D
>
> Not Working:
>
> //chldata.erdc.dren.mil/thredds/dodsC/wis/Pacific/ST81513/1981/WIS-oce
> an_waves_ST81513_198103.nc.ascii?waveSpreadWindsea%5B0:1:743%5D
>
> There are plenty of other stations which show the same issue.
>
> Would it be possible for someone (TDS developer or otherwise) to 
> assist us in tracking down why some stations work and others do not?
> We are presently using the 5.5 snapsnot with Apache Tomcat 9.0.76 and 
> Java 11.0.19.
>
> Thanks in advance,
>
> Mitchell Brown
> Coastal and Hydraulics Laboratory, ERDC
> US Army Corps of Engineers
>
>
> _______________________________________________
> NOTE: All exchanges posted to Unidata maintained email lists are 
> recorded in the Unidata inquiry tracking system and made publicly 
> available through the web.  Users who post to any of the lists we 
> maintain are reminded to remove any personal information that they do 
> not want to be made public.
>
>
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit: 
> Blockedhttps://Blockedwww.unidata.ucar.edu/mailing_lists/Blocked

_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are recorded in 
the Unidata inquiry tracking system and made publicly available through the 
web.  Users who post to any of the lists we maintain are reminded to remove any 
personal information that they do not want to be made public.


thredds mailing list
thredds@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
Blockedhttps://Blockedwww.unidata.ucar.edu/mailing_lists/Blocked 
  • 2023 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: