Re: [netcdfgroup] Contraditory change from NetCDF 4.1.3-beta1

I agree with everything in this post, building 4.1.3 has become a gigantic pain. And I didn't look in the release notes to see that the --with-hdf5 option had been eliminated and was baffled by why all the configure test programs were having trouble finding my hdf5 and szip builds. Now I have read the release notes and I see you are passing your pain onto your users. Humph! There ought to be a warning right at the beginning of the configure script, when it parses the args and switches, and also in the --help output if possible. I see the new configure setup as being broken because of all the flags that need to be set/unset, which is not the way it should be -- none of the other 25 libraries I have to build for GrADS work this way. What is the presumed standard way of finding libraries? Please add some documentation with guidance for the best way to proceed without the -- with-hdf5 (et al.) options. Does hdf5 library need a hdf5-config file or a pkgconfig file? Should we lobby the HDF Group to implement such a thing, because this new set up is really awful.
--Jennifer


On Aug 2, 2011, at 11:07 AM, Fabrício Zimmerer Murta wrote:

I’ve just read in the NetCDF’s release notes the following, for the 4.1.3-beta1 version from 2011-04-29:

“Took out --with-hdf5 and related options due to high
cost of maintaining this non-standard way of finding
libraries.”

Now, to the facts:
1. this option forces people with custom HDF5 libraries to manually change CFLAGS, FCFLAGS and LDFLAGS in compile time.
2. NetCDF 4.1.3 requires HDF5 1.8.6
3. Current linux distros comes with just HDF5 1.8.4

Result: You removed the option to select HDF libraries when it would be most needed as everyone is needing to install custom HDF5 library on their computer. This makes people lifes a lot harder, you know? I am planning on shipping NetCDF and HDF5 as nested packages with a project we are doing due to excessive compile problems, and we will be forced to add back AC_WITH_ARG for HDF5 in NetCDF provided package, in order for it to work in accordance with the main package’s arguments.

And, why did you call the AC_ARG_WITH option a non-standard way to find libraries? I thought it was a standartizing attempt from GNU autotools to aid in linking to packages...

- fabricio

From: Erik Noble
Sent: Tuesday, August 02, 2011 10:52 AM
To: Ashish
Cc: netcdfgroup@xxxxxxxxxxxxxxxx
Subject: Re: [netcdfgroup] ASCII to NetCDF

Spazm,

Go here
http://www.ncl.ucar.edu/Applications/list_io.shtml
and here
http://www.ncl.ucar.edu/Applications/read_ascii.shtml
an you should be able to find the function that will work for you. It will probably be readAsciiTable You will have to tailor it to work with your file. There are many examples to follow on that page.
-Erik

On Aug 2, 2011, at 8:57 AM, Ashish wrote:

If you do have access to MATLAB: http://www.mathworks.com/

Create a schema for the file (i.e specify the format you want, the dimensions, variables and attributes) using ncwriteschema.
You can reuse this schema in case you want to create multiple files:
http://www.mathworks.com/help/techdoc/ref/ncwriteschema.html

Read the data in using textscan.
Look at the 'HeaderLines' to skip over the comments.
http://www.mathworks.com/help/techdoc/ref/textscan.html

Write the data to the netcdf file using ncwrite.
http://www.mathworks.com/help/techdoc/ref/ncwrite.html

Depending on the size of your files and the memory available on your machine, you could either use textscan/ncwrite to read in and write all the data at one time, or loop through line/N lines and use the 'start' option in ncwrite to append the data in batches.

Ashish

On Sat, 30 Jul 2011 21:14:33 -0400, David William Pierce <dpierce@xxxxxxxx > wrote:

Do you use an analysis package such as R, IDL, or Matlab? Many such packages can create netcdf files. It might be easiest to read your files into a package you are familiar with, then write the netcdf file in the package.

Regards,

--Dave

On Sat, Jul 30, 2011 at 4:34 PM, spazm <kaan@xxxxxxxxxxxx> wrote:

Hello,

I have been googleing to find a solution to convert a couple hundreds of ASCII files to Netcdf however, the solutions I found don't really fit into
my data set. So, I wanted to ask in here.

My ASCII files come from a GWC (generic water column) data. I paste the
header and first two lines of the data below;

/# -----------------------------------------------------
# Source Files Information
# Index Filename
#  0    I:\raw\234.all
# -----------------------------------------------------
# Field Definitions
#  0    Sample File ID (see above)
#  1    Sample Position X
#  2    Sample Position Y
#  3    Sample Position Z
#  4    Sample Value (Amplitude)
#  5    Sample Time
#  6    Sample Range
#  7    Ship Position X
#  8    Ship Position Y
#  9    Ship Heading (degs)
# 10    Ship Pitch (degs)
# 11    Ship Roll (degs)
# 12    Transducer Depth (m)
# 13    Sound Speed (m/s)
# 14    Ping Number X
# 15    Ping Time X
# 16    Sample Number X
# 17    Beam Number X
# 18    Beam Azimuth X
# 19    Beam Elevation X
#0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
19
0 684028.44 4576014.50 -3.76 -127.00 0.0004 0.32 684020.44 4576016.44 238.36 3.25 -0.21 3.28 1504.3 00002 1223471556.46 1
99
0.00  13.98
0 684028.50 4576014.50 -3.86 -127.00 0.0006 0.49 684020.44 4576016.44 238.36 3.25 -0.21 3.28 1504.3 00002 1223471556.46 2
99
0.00  13.98/

Any suggestions to convert this to netcdf? I installed ferret but couldn't
manage to write the suitable code.

Thanks!

--
View this message in context:
http://netcdf-group.1586084.n2.nabble.com/ASCII-to-NetCDF-tp6637076p6637076.html
Sent from the NetCDF Group mailing list archive at Nabble.com.

_______________________________________________
netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit:
http://www.unidata.ucar.edu/mailing_lists/




_______________________________________________
netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/





_______________________________________________
netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/
_______________________________________________
netcdfgroup mailing list
netcdfgroup@xxxxxxxxxxxxxxxx
For list information or to unsubscribe,  visit: 
http://www.unidata.ucar.edu/mailing_lists/

--
Jennifer M. Adams
IGES/COLA
4041 Powder Mill Road, Suite 302
Calverton, MD 20705
jma@xxxxxxxxxxxxx



  • 2011 messages navigation, sorted by:
    1. Thread
    2. Subject
    3. Author
    4. Date
    5. ↑ Table Of Contents
  • Search the netcdfgroup archives: