Due to the current gap in continued funding from the U.S. National Science Foundation (NSF), the NSF Unidata Program Center has temporarily paused most operations. See NSF Unidata Pause in Most Operations for details.

Re: [thredds] Advantages of using FMRC over JoinExisting

Thredds folks,

 I have UGRID (unstructured grid) files I'm aggregating, so FMRC is out.

Plan B:  Is there a way to use NcML to trick joinExisting aggregation
to give me an unlimited dimension for time?

I found this page:

http://www.unidata.ucar.edu/software/netcdf-java/CDM/Opendap.html

where it sounds like adding a global attribute via NcML
     <attribute name="DODS_EXTRA/Unlimited_Dimension" value="time"/>
might have worked.  But I tried it, and it doesn't.

Does anyone have another idea?

Thanks,
-Rich

On Tue, Dec 4, 2012 at 6:22 PM, Signell, Richard <rsignell@xxxxxxxx> wrote:
> Thredds folks,
>
> We've got 33 years of ocean model output  in monthly NetCDF3 files
> that we have been aggregating into a single virtual 33TB dataset using
> joinExisting aggregation along the time dimension:
> http://www.smast.umassd.edu:8080/thredds/hindcasts.html?dataset=fvcom/hindcasts/30yr_gom3
>
> This works fine, but two issues have arisen:
>
> 1) the monthly files start at 0000 on the first day of the month, and
> end on 2400 of the last day of the month.  Thus when aggregated with
> joinExisting, we get duplicate time and data values at the end of
> every month.
>
> 2) when accessing the data via OPeNDAP, the dataset doesn't have an
> unlimited time dimension.   This causes the "nc3tonc4" conversion
> program in NetCDF4-Python to try to read each variable in it's
> entirety, which of course is problematic.  If "nc3tonc4" sees an
> unlimited dimension, it can "chunk" its way along.
>
> So we could eliminate both these problems by using a FMRC aggregation, right?
>
> Thanks,
> Rich
>
> --
> Dr. Richard P. Signell   (508) 457-2229
> USGS, 384 Woods Hole Rd.
> Woods Hole, MA 02543-1598



-- 
Dr. Richard P. Signell   (508) 457-2229
USGS, 384 Woods Hole Rd.
Woods Hole, MA 02543-1598



  • 2012 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the thredds archives: