[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[netCDF #DWJ-218174]: netcdf-c-4.6.2 make check failure



Ok, one more try.
Do this shell command (assuming bash)
    export NETCF_LOG_LEVEL=1
and rerun the test and send test-suite.log again.
This will cause the code to generate more error information.

> 
> ------------------------------
> # file libbzip2.so
> libbzip2.so: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), 
> dynamically linked, BuildID[sha1]=5df6b7d07e15116129ec320ec4ac66bed1a5fcad, 
> not stripped
> -------------------------------
> 
> -------------------------------
> # ldd libbzip2.so
> linux-vdso.so.1 =>  (0x00007ffd195cb000)
> libhdf5_hl.so.8 => /lib64/libhdf5_hl.so.8 (0x00007fb510966000)
> libhdf5.so.8 => /lib64/libhdf5.so.8 (0x00007fb51036f000)
> libm.so.6 => /lib64/libm.so.6 (0x00007fb51006d000)
> libdl.so.2 => /lib64/libdl.so.2 (0x00007fb50fe69000)
> libsz.so.2 => /lib64/libsz.so.2 (0x00007fb50fc66000)
> libz.so.1 => /lib64/libz.so.1 (0x00007fb50fa50000)
> libcurl.so.4 => /lib64/libcurl.so.4 (0x00007fb50f7e7000)
> libc.so.6 => /lib64/libc.so.6 (0x00007fb50f41a000)
> /lib64/ld-linux-x86-64.so.2 (0x00007fb510db3000)
> libaec.so.0 => /lib64/libaec.so.0 (0x00007fb50f212000)
> libidn.so.11 => /lib64/libidn.so.11 (0x00007fb50efdf000)
> libssh2.so.1 => /lib64/libssh2.so.1 (0x00007fb50edb5000)
> libssl3.so => /lib64/libssl3.so (0x00007fb50eb63000)
> libsmime3.so => /lib64/libsmime3.so (0x00007fb50e93c000)
> libnss3.so => /lib64/libnss3.so (0x00007fb50e60f000)
> libnssutil3.so => /lib64/libnssutil3.so (0x00007fb50e3e0000)
> libplds4.so => /lib64/libplds4.so (0x00007fb50e1dc000)
> libplc4.so => /lib64/libplc4.so (0x00007fb50dfd7000)
> libnspr4.so => /lib64/libnspr4.so (0x00007fb50dd99000)
> libpthread.so.0 => /lib64/libpthread.so.0 (0x00007fb50db7d000)
> libgssapi_krb5.so.2 => /lib64/libgssapi_krb5.so.2 (0x00007fb50d930000)
> libkrb5.so.3 => /lib64/libkrb5.so.3 (0x00007fb50d647000)
> libk5crypto.so.3 => /lib64/libk5crypto.so.3 (0x00007fb50d42c000)
> libcom_err.so.2 => /lib64/libcom_err.so.2 (0x00007fb50d228000)
> liblber-2.4.so.2 => /lib64/liblber-2.4.so.2 (0x00007fb50d019000)
> libldap-2.4.so.2 => /lib64/libldap-2.4.so.2 (0x00007fb50cdc4000)
> libssl.so.10 => /lib64/libssl.so.10 (0x00007fb50cb52000)
> libcrypto.so.10 => /lib64/libcrypto.so.10 (0x00007fb50c6f1000)
> librt.so.1 => /lib64/librt.so.1 (0x00007fb50c4e9000)
> libkrb5support.so.0 => /lib64/libkrb5support.so.0 (0x00007fb50c2da000)
> libkeyutils.so.1 => /lib64/libkeyutils.so.1 (0x00007fb50c0d6000)
> libresolv.so.2 => /lib64/libresolv.so.2 (0x00007fb50bebd000)
> libsasl2.so.3 => /lib64/libsasl2.so.3 (0x00007fb50bca0000)
> libselinux.so.1 => /lib64/libselinux.so.1 (0x00007fb50ba79000)
> libcrypt.so.1 => /lib64/libcrypt.so.1 (0x00007fb50b842000)
> libpcre.so.1 => /lib64/libpcre.so.1 (0x00007fb50b5e0000)
> libfreebl3.so => /lib64/libfreebl3.so (0x00007fb50b3dd000)
> ------------------------------
> 
> ------------------------------
> # nm libbzip2.so
> 000000000001155f t add_pair_to_block
> 0000000000005a86 t bsFinishWrite
> 0000000000005c4c t bsPutUChar
> 0000000000005bd7 t bsPutUInt32
> 0000000000218e40 B __bss_start
> 0000000000005b04 t bsW
> 000000000000501f T BZ2_blockSort
> 0000000000005a60 T BZ2_bsInitWrite
> 0000000000011071 T BZ2_bz__AssertH__fail
> 00000000000150ec T BZ2_bzBuffToBuffCompress
> 0000000000015234 T BZ2_bzBuffToBuffDecompress
> 0000000000015754 T BZ2_bzclose
> 0000000000011e35 T BZ2_bzCompress
> 0000000000012062 T BZ2_bzCompressEnd
> 00000000000111fe T BZ2_bzCompressInit
> 0000000000013cb9 T BZ2_bzDecompress
> 0000000000013f24 T BZ2_bzDecompressEnd
> 000000000001216d T BZ2_bzDecompressInit
> 0000000000015681 T BZ2_bzdopen
> 0000000000015810 T BZ2_bzerror
> 0000000000015745 T BZ2_bzflush
> 0000000000015376 T BZ2_bzlibVersion
> 0000000000015655 T BZ2_bzopen
> 00000000000156aa T BZ2_bzread
> 0000000000014c83 T BZ2_bzRead
> 0000000000014bac T BZ2_bzReadClose
> 0000000000014fd6 T BZ2_bzReadGetUnused
> 000000000001490c T BZ2_bzReadOpen
> 0000000000015708 T BZ2_bzwrite
> 00000000000142b5 T BZ2_bzWrite
> 0000000000014557 T BZ2_bzWriteClose
> 00000000000145a0 T BZ2_bzWriteClose64
> 0000000000014081 T BZ2_bzWriteOpen
> 000000000000b344 T BZ2_compressBlock
> 00000000002181c0 D BZ2_crc32Table
> 000000000000b6d3 T BZ2_decompress
> 0000000000005792 T BZ2_hbAssignCodes
> 0000000000005812 T BZ2_hbCreateDecodeTables
> 000000000000524e T BZ2_hbMakeCodeLengths
> 0000000000012e0b T BZ2_indexIntoF
> 00000000002185c0 D BZ2_rNums
> 00000000000110db t bz_config_ok
> 0000000000218dc0 d bzerrorstrings
> 0000000000015383 t bzopen_or_bzdopen
> 0000000000218e40 b completed.6355
> 0000000000011838 t copy_input_until_stop
> 0000000000011bd3 t copy_output_until_stop
> U __ctype_b_loc@@GLIBC_2.3
> w __cxa_finalize@@GLIBC_2.2.5
> 00000000000110e6 t default_bzalloc
> 0000000000011113 t default_bzfree
> 0000000000001920 t deregister_tm_clones
> 0000000000001990 t __do_global_dtors_aux
> 0000000000217cf0 t __do_global_dtors_aux_fini_array_entry
> 0000000000217d00 d __dso_handle
> 0000000000217d50 d _DYNAMIC
> 0000000000218e40 D _edata
> 0000000000218e48 B _end
> U exit@@GLIBC_2.2.5<mailto:exit@@GLIBC_2.2.5>
> 000000000000200e t fallbackQSort3
> 0000000000001e26 t fallbackSimpleSort
> 0000000000002638 t fallbackSort
> U fclose@@GLIBC_2.2.5<mailto:fclose@@GLIBC_2.2.5>
> U fdopen@@GLIBC_2.2.5<mailto:fdopen@@GLIBC_2.2.5>
> U ferror@@GLIBC_2.2.5<mailto:ferror@@GLIBC_2.2.5>
> U fflush@@GLIBC_2.2.5<mailto:fflush@@GLIBC_2.2.5>
> U fgetc@@GLIBC_2.2.5<mailto:fgetc@@GLIBC_2.2.5>
> 000000000001585c T _fini
> 0000000000011804 t flush_RL
> U fopen@@GLIBC_2.2.5<mailto:fopen@@GLIBC_2.2.5>
> U fprintf@@GLIBC_2.2.5<mailto:fprintf@@GLIBC_2.2.5>
> U fputc@@GLIBC_2.2.5<mailto:fputc@@GLIBC_2.2.5>
> 00000000000019d0 t frame_dummy
> 0000000000217ce8 t __frame_dummy_init_array_entry
> 0000000000016f10 r __FRAME_END__
> U fread@@GLIBC_2.2.5<mailto:fread@@GLIBC_2.2.5>
> U free@@GLIBC_2.2.5<mailto:free@@GLIBC_2.2.5>
> U fwrite@@GLIBC_2.2.5<mailto:fwrite@@GLIBC_2.2.5>
> 0000000000005cde t generateMTFValues
> 0000000000218000 d _GLOBAL_OFFSET_TABLE_
> w __gmon_start__
> 0000000000016408 r __GNU_EH_FRAME_HDR
> U H5allocate_memory
> U H5free_memory
> 0000000000001a10 T H5PLget_plugin_info
> 0000000000001a05 T H5PLget_plugin_type
> 0000000000217d20 D H5Z_BZIP2
> 0000000000001a1d T H5Z_bzip2_can_apply
> 0000000000001a31 T H5Z_filter_bzip2
> 0000000000011ca4 t handle_compress
> 0000000000218180 d incs
> 0000000000001640 T _init
> 00000000000111af t init_RL
> 00000000000111cf t isempty_RL
> w _ITM_deregisterTMCloneTable
> w _ITM_registerTMCloneTable
> 0000000000217cf8 d __JCR_END__
> 0000000000217cf8 d __JCR_LIST__
> w _Jv_RegisterClasses
> 0000000000002e57 t mainGtU
> 000000000000399d t mainQSort3
> 00000000000035d7 t mainSimpleSort
> 00000000000041f7 t mainSort
> 000000000000b65d t makeMaps_d
> 0000000000005c74 t makeMaps_e
> U malloc@@GLIBC_2.2.5<mailto:malloc@@GLIBC_2.2.5>
> 0000000000003947 t mmed3
> 0000000000014041 t myfeof
> 0000000000011138 t prepare_new_block
> U realloc@@GLIBC_2.2.5<mailto:realloc@@GLIBC_2.2.5>
> 0000000000001950 t register_tm_clones
> 00000000000060a1 t sendMTFValues
> U stderr@@GLIBC_2.2.5<mailto:stderr@@GLIBC_2.2.5>
> U stdin@@GLIBC_2.2.5<mailto:stdin@@GLIBC_2.2.5>
> U stdout@@GLIBC_2.2.5<mailto:stdout@@GLIBC_2.2.5>
> 0000000000218e40 d __TMC_END__
> U ungetc@@GLIBC_2.2.5<mailto:ungetc@@GLIBC_2.2.5>
> 0000000000012302 t unRLE_obuf_to_output_FAST
> 0000000000012e6e t unRLE_obuf_to_output_SMALL
> ------------------------------------
> 
> 
> On 01/02/2019 01:32 PM, Unidata netCDF Support wrote:
> 
> I am baffled. The output you send looks exactly right
> up to the point where the hdf5 library attempts to load
> libbzip2.so to do the compression. At this point,
> the only thing I can conclude is that there is something
> wrong with plugins/.libs/libbzip2.so.
> Can you do
> file plugins/.libs/libbzip2.so
> and
> ldd plugins/.libs/libbzip2.so
> and
> nm plugins/.libs/libbzip2.so
> so we can get some idea is there is anything
> odd about that dynamically loaded library?
> 
> 
> 
> 
> OK - I added "set -x" to tst_filter.sh.  Note that the original first line
> in tst_filter.sh is already:
> 
> export SETX=1
> 
> which seems like it may have a similar effect.
> 
> I ran a "make check" from within the ~/netcdf-c-4.6.2/nc_test4 (hopefully 
> that's
> what you wanted), and attached those log files, which did get a recent time 
> stamp.
> 
> The "make check" output still displayed the one failure.
> 
> 
> On 01/02/2019 12:26 PM, Unidata netCDF Support wrote:
> 
> That looks ok and should work.
> Sinc test_filter is executed in tst_filter.sh,
> we need to trace the action of tst_filter.sh.
> So, edit nc_test4/tst_filter.sh and insert the line
> set -x
> just past the #!/bin/sh.
> 
> Then rerun the tests in nc_test4 and send me the
> test_suite.log and the nc_test4/tst_filter.log files.
> 
> 
> 
> The *.so files are in ~/netcdf-c-4.6.2/plugins/.libs
> 
> [root@genesis .libs]# ls -la
> total 276
> drwxr-xr-x 2 root   root     4096 Dec 28 15:36 .
> drwxr-xr-x 4 merlin merlin   4096 Dec 28 15:36 ..
> -rw-r--r-- 1 root   root    17104 Dec 28 15:36 blocksort.o
> -rw-r--r-- 1 root   root    29568 Dec 28 15:36 bzlib.o
> -rw-r--r-- 1 root   root    27440 Dec 28 15:36 compress.o
> -rw-r--r-- 1 root   root     2000 Dec 28 15:36 crctable.o
> -rw-r--r-- 1 root   root    26464 Dec 28 15:36 decompress.o
> -rw-r--r-- 1 root   root     4680 Dec 28 15:36 H5Zbzip2.o
> -rw-r--r-- 1 root   root     5544 Dec 28 15:36 H5Zmisc.o
> -rw-r--r-- 1 root   root     3712 Dec 28 15:36 huffman.o
> lrwxrwxrwx 1 root   root       14 Dec 28 15:36 libbzip2.la -> ../libbzip2.la
> -rw-r--r-- 1 root   root      957 Dec 28 15:36 libbzip2.lai
> -rwxr-xr-x 1 root   root   109976 Dec 28 15:36 libbzip2.so
> lrwxrwxrwx 1 root   root       13 Dec 28 15:36 libmisc.la -> ../libmisc.la
> -rw-r--r-- 1 root   root      966 Dec 28 15:36 libmisc.lai
> -rwxr-xr-x 1 root   root    12776 Dec 28 15:36 libmisc.so
> -rw-r--r-- 1 root   root     3024 Dec 28 15:36 randtable.o
> 
> 
> 
> On 12/28/2018 06:58 PM, Unidata netCDF Support wrote:
> 
> THe more I think about it, the more I think my speculation is wrong
> because the bzip2 library code is directly compiled into the plugin.
> The key error is this:
> 
> 
> fail (218): NetCDF: Filter error: bad id or parameters or filter library 
> non-existent
> 
> 
> Can you do a "find" command on the plugins directory so I can see
> where the .so files are located?
> 
> 
> 
> 
> Perhaps the Makefile should explicitly set the path to the bzip2 library
> in the plugins directory.
> 
> 
> On 12/28/2018 03:00 PM, Unidata netCDF Support wrote:
> 
> The netcdf-c source directory contains is own bzip2 implementation
> in the plugins directory. My speculation is that somehow,
> the plugins code is picking up your version and there is some kind
> of API mismatch. Not sure how to fix. If you
> are explicitly including bzip with -lbzip2 or -lbz2 you might
> try removing it.
> 
> 
> 
> 
> On a CentOS 7 PC:
> 
> uname -a  = Linux genesis 3.10.0-957.1.3.el7.x86_64 #1 SMP Thu Nov 29 
> 14:49:43 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
> redhat-release = CentOS Linux release 7.6.1810 (Core)
> 
> bzip2 is installed:
> 
> [root@genesis netcdf-c-4.6.2]# rpm -qa |grep bzip
> bzip2-libs-1.0.6-13.el7.i686
> bzip2-devel-1.0.6-13.el7.x86_64
> bzip2-1.0.6-13.el7.x86_64
> bzip2-libs-1.0.6-13.el7.x86_64
> 
> The error from "make check" is not very helpful:
> 
> -----------
> + /local/src/NetCDF/netcdf-c-4.6.2/nc_test4/test_filter
> fail (218): NetCDF: Filter error: bad id or parameters or filter library 
> non-existent
> 
> *** Testing API: bzip2 compression.
> show parameters for bzip2: level=9
> show chunks: chunks=4,4,4,4
> FAIL tst_filter.sh (exit status: 1)
> 
> 
> 
> 
> =Dennis Heimbigner
> Unidata
> 
> 
> Ticket Details
> ===================
> Ticket ID: DWJ-218174
> Department: Support netCDF
> Priority: Normal
> Status: Open
> ===================
> NOTE: All email exchanges with Unidata User Support are recorded in the 
> Unidata inquiry tracking system and then made publicly available through the 
> web.  If you do not want to have your interactions made available in this 
> way, you must let us know in each email you send to us.
> 
> 
> 
> 
> 
> 
> 
> 
> =Dennis Heimbigner
> Unidata
> 
> 
> Ticket Details
> ===================
> Ticket ID: DWJ-218174
> Department: Support netCDF
> Priority: Normal
> Status: Open
> ===================
> NOTE: All email exchanges with Unidata User Support are recorded in the 
> Unidata inquiry tracking system and then made publicly available through the 
> web.  If you do not want to have your interactions made available in this 
> way, you must let us know in each email you send to us.
> 
> 
> 
> 
> 
> 
> 
> 
> =Dennis Heimbigner
> Unidata
> 
> 
> Ticket Details
> ===================
> Ticket ID: DWJ-218174
> Department: Support netCDF
> Priority: Normal
> Status: Open
> ===================
> NOTE: All email exchanges with Unidata User Support are recorded in the 
> Unidata inquiry tracking system and then made publicly available through the 
> web.  If you do not want to have your interactions made available in this 
> way, you must let us know in each email you send to us.
> 
> 
> 
> 
> 
> 
> 
> 
> =Dennis Heimbigner
> Unidata
> 
> 
> Ticket Details
> ===================
> Ticket ID: DWJ-218174
> Department: Support netCDF
> Priority: Normal
> Status: Open
> ===================
> NOTE: All email exchanges with Unidata User Support are recorded in the 
> Unidata inquiry tracking system and then made publicly available through the 
> web.  If you do not want to have your interactions made available in this 
> way, you must let us know in each email you send to us.
> 
> 
> 
> 
> 

=Dennis Heimbigner
  Unidata


Ticket Details
===================
Ticket ID: DWJ-218174
Department: Support netCDF
Priority: Normal
Status: Open
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.