Re: [thredds] NCSS: deselect latitude, longitude, and station number in single-station time-series?

  • To: Ryan May <rmay@xxxxxxxx>
  • Subject: Re: [thredds] NCSS: deselect latitude, longitude, and station number in single-station time-series?
  • From: John Caron <jcaron1129@xxxxxxxxx>
  • Date: Tue, 1 Mar 2016 14:27:14 -0700
With compression, I wonder if the bandwidth is so bad? Would be helpful to
measure.

On Tue, Mar 1, 2016 at 2:16 PM, Ryan May <rmay@xxxxxxxx> wrote:

> Aaron,
>
> The answer to your question is: no, the TDS can't do this...currently. We
> do have plans to focus some improvements on our support for observational
> point data, so we'll be sure to keep this use case in mind.
>
> Sorry I can't give you a better answer for today, though.
>
> Ryan
>
> On Tue, Mar 1, 2016 at 1:58 PM, Aaron Sweeney - NOAA Affiliate <
> aaron.sweeney@xxxxxxxx> wrote:
>
>> Hi, Rich,
>>
>>       Thanks very much for the information on what additional formats
>> ERDDAP supports.  Yes, many users just want CSV.  Unfortunately, ERDDAP is
>> not a viable option for me at this time.
>>
>>       So I suppose it's still an open question if TDS can support this
>> use-case through NCSS.
>>
>> Thanks,
>> Aaron
>>
>> On Tue, Mar 1, 2016 at 12:38 PM, Signell, Richard <rsignell@xxxxxxxx>
>> wrote:
>>
>>> Aaron,
>>>
>>> If you guys have essentially tabular data in CF-1.6 compliant netcdf
>>> files (which it looks like you do), and want to deliver CSV, JSON and
>>> other formats for users, you might consider setting up an ERDDAP
>>> server in addition to THREDDS.   Folks love that you can download CSV,
>>> JSON, .mat files, etc using RESTFUL syntax, just like the NCSS.
>>>
>>> ERDDAP has the ability to read directly from CF-1.6 NetCDF files:
>>>
>>> http://coastwatch.pfeg.noaa.gov/erddap/download/setupDatasetsXml.html#EDDTableFromNcCFFiles
>>> and installation/setup/maintenance of ERDDAP has become a lot easier
>>> now that it's been dockerized:
>>> https://hub.docker.com/r/axiom/docker-erddap/
>>>
>>> Here's a site installed with ERDDAP container that hosts CF-1.6 netCDF
>>> files:
>>>
>>> http://hydromet-thredds.princeton.edu:8000/erddap/info/index.html?page=1&itemsPerPage=1000
>>>
>>> Here's a example request of  data from just two variables for the last 7
>>> days:
>>>
>>> 1. as htmlTable:
>>>
>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.htmlTable?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>
>>> 2. as CSV
>>>
>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.csv?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>
>>> 3. as JSON
>>>
>>> http://hydromet-thredds.princeton.edu:8000/erddap/tabledap/butler.json?time,RH,TCroof_Avg&time%3E=now-7days&time%3C=now
>>>
>>> I say this as a happy THREDDS Data Server user -- no reason not to
>>> have both TDS and ERDDAP, but ERDDAP is especially nice for tabular
>>> data.
>>>
>>> -Rich
>>>
>>> On Mon, Feb 29, 2016 at 6:40 PM, Aaron Sweeney - NOAA Affiliate
>>> <aaron.sweeney@xxxxxxxx> wrote:
>>> > Hi,
>>> >
>>> >      I am providing netCDF data via TDS and using NCSS (subset
>>> service) to
>>> > provide the option of downloading data as CSV.
>>> >
>>> >      Is it possible to deselect latitude, longitude, and station
>>> number in a
>>> > time-series netCDF file that contains only one station with one
>>> latitude and
>>> > longitude?  The resultant CSV files contain extra columns for station
>>> > number, latitude, and longitude.  Because these values never change,
>>> this
>>> > seems like a waste of bandwidth.  In my netCDF files, I have specified
>>> the
>>> > dimension of the timeSeries to 1, rather than leave it out entirely.
>>> >
>>> >       Here's a live example where I'm selecting four physical
>>> variables via
>>> > NCSS, but I also get back station number, latitude, and longitude:
>>> >
>>> >
>>> http://www.ngdc.noaa.gov/thredds/ncss/dart_bpr/processed/54401/54401_20090912to20130828_qc.nc?var=seafloor_pressure_abs_quality_controlled&var=seafloor_pressure_abs_modelled&var=seafloor_pressure_residual&var=temperature&temporal=all&accept=csv
>>> >
>>> > Thanks,
>>> > Aaron
>>> >
>>> > --
>>> > Aaron D. Sweeney
>>> > Water Level Data Manager
>>> >
>>> > Cooperative Institute for Research in Environmental Sciences (CIRES)
>>> > University of Colorado at Boulder
>>> > and
>>> > NOAA National Centers for Environmental Information
>>> > formerly NOAA's National Geophysical Data Center
>>> > 325 Broadway, E/NE42
>>> > Boulder, CO 80305-3328
>>> >
>>> > Phone: 303-497-4797, Fax: 303-497-6513
>>> >
>>> > DISCLAIMER: The contents of this message are mine personally and do not
>>> > necessarily reflect any position of NOAA.
>>> >
>>> > _______________________________________________
>>> > thredds mailing list
>>> > thredds@xxxxxxxxxxxxxxxx
>>> > For list information or to unsubscribe,  visit:
>>> > http://www.unidata.ucar.edu/mailing_lists/
>>>
>>>
>>>
>>> --
>>> Dr. Richard P. Signell   (508) 457-2229
>>> USGS, 384 Woods Hole Rd.
>>> Woods Hole, MA 02543-1598
>>>
>>
>>
>>
>> --
>> Aaron D. Sweeney
>> Water Level Data Manager
>>
>> Cooperative Institute for Research in Environmental Sciences (CIRES)
>> University of Colorado at Boulder
>> and
>> NOAA National Centers for Environmental Information
>> *formerly NOAA's National Geophysical Data Center*
>> 325 Broadway, E/NE42
>> Boulder, CO 80305-3328
>>
>> Phone: 303-497-4797, Fax: 303-497-6513
>>
>> DISCLAIMER: The contents of this message are mine personally and do not
>> necessarily reflect any position of NOAA.
>>
>> _______________________________________________
>> thredds mailing list
>> thredds@xxxxxxxxxxxxxxxx
>> For list information or to unsubscribe,  visit:
>> http://www.unidata.ucar.edu/mailing_lists/
>>
>
>
>
> --
> Ryan May, Ph.D.
> Software Engineer
> UCAR/Unidata
> Boulder, CO
>
> _______________________________________________
> thredds mailing list
> thredds@xxxxxxxxxxxxxxxx
> For list information or to unsubscribe,  visit:
> http://www.unidata.ucar.edu/mailing_lists/
>
  • 2016 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: