•         advanced

LDM 6.2.0 Release Notes

• Changes from LDM 6.1

• Known Problems

• Added "rpc" subpackage -- replacing use of the native RPC library -- to work-around a bug in the AIX 5.1 ONC RPC 4.0 implementation, which fails when receiving large (~10 MB) RPC messages (i.e., most NIMAGE data wasn't being received).

• Modified product-queue (pq) module:

  • Corrected bug in pq(3) module when inserting a data-product that has the same insertion-time as an already existing data-product. The insertion-time in now incremented by one microsecond to ensure unique keys in the time-map rather than using the byte-offset of the data-product. Hopefully, this will eliminate the rare occurrence in which a data-product is missed by a product-queue reader because it has the same insertion-time as the previous data-product in the product-queue but has a smaller byte-offset.

  • Corrected fClr() and fMask() macros in file "pq/fbits.h" so that they correctly handle the case where the "flag" variable is smaller than the variable in question. This removes a problem creating product-queues with data-sections larger than (2^32)-1 bytes on systems where sizeof(size_t) == 8 and sizeof(unsigned) == 4.

• Made all programs that use regular-expressions convert all externally-specified pathological regular-expressions into non-pathological ones.

• Modified top-level LDM server:

  • Removed latent bug that caused file-descriptor table to fill-up -- preventing additional connections -- if fork(2)s failed for a while.

  • Corrected bug in LDM configuration-file parser. The LDM will now log an error-message and terminate if it encounters an invalid feedtype expression.

• Modified downstream (i.e., receiving) LDM:

  • Changed the way the "last" data-product creation-time is saved. Before, the creation-time of the most recently received data-product was used. Now, that time is used only if it is more recent than the saved time. This should reduce problems caused by the sequential arrival of data-products with creation-times that are non-monotonic.

  • Modified down6_get_last_arrival() to accomodate SunOS 5.8's c89(1).

  • Improved error-messages when the LDM can't connect to an upstream LDM.

• Modified programs to reduce artificially-induced latencies:

  • Modified the toClients() function in the "pqing" module so that the "arrival" argument is ignored and the creation-time of the data-product is set within the function itself. This should reduce the (apparent) latency on systems doing data-product ingestion.

  • Modified the pqinsert(1) utility so that the data-product creation- time is set just prior to inserting the data-product into the product-queue. This should reduce any (apparent) latency.

• Modified pqact(1). A configuration-file with no entries is now logged as such rather than as having a syntax error.

• Modified rtstats(1):

  • A warning-level error-message is logged if it can't connect to the remote LDM.

  • The latency field in the data-product it creates is now formatted "%g" from a floating-point value.

• Modified pqcheck(1). Added support for logging debug-level messages (-x option).

• Modified scour(1) utility to work-around bug in OSF1's find(1) utility.

• Ensured that all utilities log messages of level LOG_WARNING.

• Modified ldmadmin(1) script:

  • Moved the configuration section of ldmadmin(1) into a separate file (etc/ldmadmin-pl.conf). A consequence of this is that if the environment variable LDMHOME is not set, then $HOME is used.

  • Removed setting of UDUNITS_PATH because it doesn't have anything to do with running the LDM. User's who need this environment variable set in order for the gribtonc(1) decoder to work properly should set it in the profile-file of the LDM user's user-shell.

  • Corrected default value of $surf_size variable. Previous value of "2M" caused command "ldmadmin mksurfqueue" to hang.

  • Fixed bug in ldmadmin(1) so that "ldmadmin watch -f 'IDS|DDPLUS'" now works.

  • Made "ldmadmin clean" abort if the LDM system is running.

  • Corrected use of "$?".

  • Corrected some error-messages.

• Added scouring of ~ldm/logs/*.stats files to example scour(1) configuration-file.

• Ported package to

  • Darwin (alias Mac OS X)

  • SunOS 5.10 (alias Solaris 10)

  The package has poor performance under SunOS 5.10. Sun is investigating.

• Modified configure(1) script:

  • Made the script try to create an LDM system that supports product-queue sizes up to (2^32)-1 bytes.

  • Added "--disable-max-size" option so that the user can ensure that the resulting LDM only supports smaller product-queue sizes (to use a previously-existing product-queue, for example).

  • Corrected test for non-socket /dev/log.

  • Now augments, rather than replaces, a user-specified CPPFLAGS.

• Modified makefiles:

  • Modified top-level makefile to get libldm.a(ldm_version.o) updated when VERSION is modified.

  • "make clean" no longer removes *.log files; "make distclean" does.

• Removed files INSTALL and INSTALL.bin from distribution after moving their information to file README.

• Renamed this file (HISTORY) to CHANGE_LOG.

• ldmadmin doesn't work.

  If the ldmadmin script prints the following:

  ...ldmadmin-pl.conf did not return a true value at /usr/local/ldm/bin/ldmadmin line 56.

  then add the following statement as the last line in the ldmadmin configuration-file, $LDMHOME/etc/ldmadmin-pl.conf:

  1;

  (Its a perl(1) thing.)

• RELEASE_NOTES is missing from the distribution. It was in the announcement sent to the ldm-users mailing-list and it can also be found found by going to the GForge webpages of the LDM Project at http://gforge.unidata.ucar.edu/projects/ldm/. Click on the appropriate book icon in the "Latest File Releases" section.

• A request-line like the following

  REQUEST IDS/DDPLUS .* hostId

  will cause the resulting downstream LDM to request from host hostId, data-products of feedtype IDS whose data-product identifiers match the ERE /DDPLUS -- which is undoubtably wrong. The solution is to use a vertical bar instead of a slash in the feedtype specification.

• Line 151 in file src/scripts/ldmadmin.in

  system("$^X $bin_path/mailpqstats -d $log_path -h $hostname");

  should, instead, be

  system("$bin_path/mailpqstats -d $log_path -h $hostname");

  Note that the enveloping ldmadmin dostats command has been deprecated for years and should no longer be used.

Reporting Problems

If you encounter bugs or problems, please contact support@unidata.ucar.edu. Include in the email all relevant items mentioned in the instructions.

Contact Us   •   Site Map   •   Search   •   Terms and Conditions   •   Privacy Policy   •   Participation Policy

Unidata is a member of the UCAR Office of Programs, is managed by the University Corporation for Atmospheric Research, and is sponsored by the National Science Foundation. P.O. Box 3000   •   Boulder, CO 80307-3000 USA   •   Tel: 303-497-8643   •   Fax: 303-497-8690