Unidata - To provide the data services, tools, and cyberinfrastructure leadership that advance Earth system science, enhance educational opportunities, and broaden participation. Unidata
         
  advanced  
 

Unidata McIDAS-X - v2004 Release Notes


This document describes significant changes between Unidata McIDAS-X Versions 2003 and 2004.

Before Installing McIDAS-X

Complete all Required Actions below.

Core Software Changes

Review the changes to core software before installing McIDAS-X 2004. McIDAS-X Significant Changes lists some of the significant changes since the last upgrade. Two ASCII text files, MAY04PRG.TXT and MAY04INQ.TXT, list all software changes made to McIDAS-X since the previous upgrade. A third file, MAY04OPN.TXT, lists all software bugs known at the time this upgrade was distributed.

Required Action:

    See McIDAS-X Significant Changes of this document to review the significant changes made to core software.


Operating System and Compiler Changes

Beginning with this upgrade, the following changes were made to operating system and compiler versions that McIDAS-X is supported on.


Compatibility with -X Remote Servers and -XCD

McIDAS-X 2004 can run in a stand-alone mode. However, many commands can access data on other workstations (remote servers). Therefore, your McIDAS-X client workstations and the remote servers they access must be running compatible versions in order for all features to work as expected.

For example, use of the three items below is dependent upon the McIDAS-X version that the client and/or server is running.


Required Action:
    Coordinate upgrading your site's McIDAS-X and -XCD systems according to your needs, considering the compatibility requirements listed above.


Deleted Command

The FOUSRPT command was deleted from McIDAS-X beginning with this upgrade. It was deleted because its functionality is available in the command MOSRPT (which was added in version 2003, and can list ETA and GFS, as well as NGM, MOS forecasts).

Required Action:

    Change all occurrences of FOUSRPT to MOSRPT in your scripts, macros, BATCH files, F-Key Menus, McBASI programs, and SKE entries.


Disk Space

McIDAS-X disk space requirements increased, mainly due to the addition of new servers.

The overall disk space requirements for obtaining, building and installing McIDAS-X 2004 are listed in the table below. The disk space requirements for 2003 are listed for comparison. The compiler type (vendor or gcc/g77) used for each build are also listed.


Operating system Compilers McIDAS-X 2003 McIDAS-X 2004

AIX 5L version 5.1 vendor 345 MB 395 MB
Fedora Core 1 Linux gcc/g77 320 MB 328 MB
FeeBSD 4.[89] gcc/g77 320 MB 328 MB
HP-UX 11.11 vendor 390 MB 435 MB
IRIX 6.5 vendor 455 MB 455 MB
Mac OS X gcc/g77 n/a 410 MB
Solaris 9 SPARC vendor 420 MB 395 MB
Solaris 9 x86 vendor 355 MB 355 MB
True64 Unix vendor 420 421 MB
Windows XP Pro gcc/g77 n/a 295 MB

Required Action:

    Verify that you have sufficient disk space available to obtain, build, and install McIDAS- X 2004.


Installing McIDAS-X

If you need assistance with the upgrade, please send email to <support@unidata.ucar.edu&tg;.


McIDAS-X Significant Changes

Complete all Required Actions below. Optional Actions are only for your consideration.


ADDE Data Transfer Methods

In McIDAS-X versions 2003 and later, you can request data from ADDE remote servers using three different transfer methods. The methods are gzip- compressed, compressed, and uncompressed.

The default method is determined by the MCCOMPRESS environment variable. In this upgrade, a new global keyword that overrides the environment variable was added. The new global keyword is named MCCOMPRESS=, which can also be specified as MCC=. For example, IMGDISP GOES/EAST 5 BAND=4 STA=KATL MCC=GZIP overrides the environment variable setting and requests that the remote server use gzip to compress the specified image data, then send it to your workstation, which uses gunzip to uncompress it then displays it in frame 5.

In McIDAS-X 2003, requests for gzip-compressed data are sent to server port 112, compressed to server port 503, and uncompressed to server port 500. Beginning with this upgrade, all requests, regardless of the data transfer method, are sent to server port 112. In all cases, after receiving the client's request, the remote server gathers the requested data and uses the appropriate compression method to package the data, then sends it to the client through the same port.

Important Notes:

  1. The gzip-compressed and compressed methods are usually best for transferring large data files over slow data connections. The uncompressed method minimizes overhead and therefore is usually the best method to use if the remote servers you access are on a network with fast data transfer rates.

  2. Sites with firewalls or other screening mechanisms must open port 112 on their remote servers if they want to allow clients running McIDAS-X 2004 to access their data. Likewise, ports 500 and 503 must also be open to allow clients running McIDAS-X 2003 to access their data.

Required Action:

    Users who want to choose between the three data transfer methods must read and complete the instructions in the Using Compressed Data Transfers section of the McIDAS User's Guide.

    After installing McIDAS-X 2004 on their ADDE remote servers, administrators must install the McIDAS-X 2004 ADDE remote server (using the mcinet2004.sh script). This step is required because the script was modified to work better with newer versions of xinetd. See Installing the McIDAS-X 2004 ADDE Remote Server and Updating Clients to Use Compressed Data Transfers in the Unidata McIDAS User's Guide for more information and the installation instructions.


McIDAS-X GUI

The McIDAS-X GUI was modified to include the changes listed below.

Optional Action:
    Use the GUI by starting it with the GUI command, selecting the Start GUI upon McIDAS startup option in the mcidas -config GUI, or automatically start the GUI with each McIDAS-X session by adding a -c GUI command in the Run commands at startup section of your .mcidasrc file.


PRDUTIL Command

The PRDUTIL command was modified to use the IMGLIST command to generate its output, instead of using an internal version. It was also modified to no longer allow its file specification as an area number (i.e., you must specify an ADDE dataset name and position number instead of an area number).


Required Action:

    Check all occurrences of PRDUTIL commands in your macros, scripts, BATCH files, F Key Menus, McBASI programs and SKE entries to see if they specify an area number in the file/dataset parameter. If any do, change their area number to an ADDE dataset name and position number that maps to that area number. For example, if you have a local dataset named LOCAL/AREAS that is mapped to areas 1-9999 and you have a script that runs command PRDUTIL LIST 1250, change the command to PRDUTIL LIST LOCAL/AREAS.1250.


AXFORM Command

The AXFORM command was modified to left- or right- justify the values in its HDR output file. Therefore, values in fields like Band, Lines and Elements are usually in different columns than in previous versions.


Required Action:

    Check your scripts to see if they read HDR files and parse their values. If so, modify the column offsets to those used in the HDR files generated by the McIDAS-X 2004 version of AXFORM.


Other Modifications

The modifications below require no special action.


Command / TopicModification

FRMSAVE fixed to save what you see on the display; so if the image or graphics is toggled off (with K or W commands) it will not be included in the file created with FRMSAVE
GEO added DAY and TIME keywords to select an earlier image
LWCON added FLIP keyword to control when words containing ASCII text are byte flipped
LWU added bword and eword parameters to COPY option to specify a range of words to copy from the source file
MAP added options to the LABEL keyword to choose the latitude and longitude label formats, and added LLMARK keyword to draw reference symbols (e.g., plus signs (+)) at the specified latitude and longitude intervals
NAVCALC added IMC keyword to choose whether to list the actual GVAR (GOES-8 and later) satellite subpoint, or that corrected by the Image Motion Compensator
PTDISP, RAOBPLOT, SFCPLOT updated COLOR keyword to allow choice of plot color based on parameter value; for example, SFCPLOT T USA COLOR=2[50-89B10] plots 50-59°F temperatures in graphics color level 2, 60-69°F in level 3, 70-79°F in level 4 and 80-89°F in level 5; temperatures less than 50°F are in level 1, and temperatures greater than 89°F are in level 6
PTLIST added DM and DMS options to FORMAT keyword to list latitude and longitude values in degrees:minutes and degrees:minutes:seconds, respectively; the default format for latitude and longitude values is decimal (which can be altered with the keyword's F option)
SFCCON, SFCPLOT modified the equations that calculate station pressure to, by default, use altimeter setting instead of sea-level pressure; this affects the PSTN, MIX, THA and THAE options because they are calculated using station pressure
ZA replaced the L, C and R options in the justify parameter with new options that allow vertical, as well as horizontal, positioning; the new options are LA, LC, LB, CA, CC, CB, RA, RC and RB, where L means left, C means center, R means right, A means above and B means below the center of the cursor; to retain backward compatibility, entering L, C or R for the 'justify' parameter will work the same as it did in previous versions
WL and WN Keywords added WL and WN keywords to IMGCOPY, IMGDISP, IMGFILT, IMGLIST, IMGPROBE and IMGREMAP commands that allow you to select Aqua AIRS data based on wavelength and wave number
WMO Weather Symbol Fonts updated GRDDISP, PTDISTP, SFCMG and SFCPLOT commands to use the new WMO weather symbol fonts listed in the Data Files section; the most significant change is that the calm wind symbol plotted with commands like SFCPLOT WINDB or PTDISP PAR=WIND FORMAT=VECT has been changed from a plus sign (+) to a small bullseye (two concentric circles)
AIRS HDF Servers added AIRS HDF servers to McIDAS-X to allow creation of datasets containing AIRS data in HDF format on local and remote servers, and display or manipulation of the data using the IMG* commands; see the DSSERVE command's online help or its documentation in the McIDAS User's Guide (revised 5/04) for information about creating the datasets
GeoTIFF Servers added GeoTIFF servers to McIDAS-X to allow creation of GeoTIFF files with the IMGCOPY, IMGFILT, IMGOPER or IMGREMAP commands; see the DSSERVE command's online help or its documentation in the McIDAS User's Guide (revised 5/04) for information about creating the datasets
MODIS HDF Servers updated to allow use of files with names that follow the MODIS Direct Broadcast file naming conventions, as well as those that follow the Goddard DAAC file naming conventions
netCDF Image Server modified to allow use of the DIRFILE keyword in the DSSERVE command for determining where to write newly-created files
POES Level 1b Servers added option to use the SAA Level 1b file's line-by-line lat/lon navigation (rather than the orbital navigation at the beginning of the file) by specifying INFO=LALO in the DSSERVE command; also added new servers to write POES/NOAA KLM AVHRR area data to SAA Level 1b file format; see the DSSERVE command's online help or its documentation in the McIDAS User's Guide (revised 5/04) for more information


Data Files

The following changes were made to files in the ~mcidas/data directory.


File nameChange

AIRSBAND.DOC new text file containing information about each of the 2378 bands (channels) in AIRS data
AIRSBANDINFO new binary file created from AIRSBAND.DOC that the AIRS server uses to map wavelength and wave number to band number
CORE.SAT changed MSG-1, MSG-2 and MSG-3 entries to Meteosat-8, Meteosat-9 and Meteosat-10
DCETAMOS increased number of rows from 38 to 42 and number of columns from 350 to 2000; added category FW (for "few") to CLD field; added seven new fields (CIG, OBV, POS, POZ, SNW, TYP, VIS)
DCGFSMOS increased number of rows from 38 to 42 and number of columns from 350 to 2000; added category FW (for "few") to CLD field; added new field SNW
DCISFC increased number of columns from 3500 to 7000
MAP.CORE added new global keyword LLMARK to draw reference symbols, e.g., plus signs (+), at the specified latitude and longitude intervals; the global default value is set to NO
netcdfgrid.cfg added new comments to make it more informative
netcdfbuoy.nc new sample netCDF point file containing buoy data; netcdfpoint.cfg is a sample configuration file for this type of data
OUTLHRES updated to remove an extra line that was extending off the Ross Ice Shelf in Antarctica
SATANNOT changed sensor source numbers 51, 52 and 53 from MSG-1, MSG-2 and MSG-3 to Meteosat-8, Meteosat-9 and Meteosat-10
SATBAND added band information for AIRS (2378 channels) and reordered MSG bands to match Eumetsat's ascending-wavelength order
SFCPLOT.CORE changed the format of VIS plots from F4.1 to F5.1 to accommodate triple-digit visibilities
STNDB.CORE updated to contain state codes for countries other than the United States (e.g., BC for stations in British Columbia, Canada); changed state field from CA to TX for station KBYY (Bay City, Texas); updated lists of ETA MOS and GFS MOS stations
USCOUNTY.MAP, USZONE.MAP updated to most recent versions as of 14 April 2004
WXSYM.FFD, wxsymr*.bdf updated WMO weather symbol font package so there is consistency across all sizes
XRD2004.TXT updated with list of commands and data files in McIDAS-XRD version 2004 sidecar package; run McIDAS-X command SEE XRD2004.TXT to view the list


Required Action:

    Merge these modifications with all local copies of the data files.


Local Code

Compile and link all local code after installing the upgrade. Listed below are some of the software and structural changes most likely to affect your local code.


McIDAS-XCD Compatibility with McIDAS-X

The McIDAS-XCD software is dependent on the McIDAS-X library and data files. McIDAS-X 2004 must be installed on the system prior to McIDAS-XCD 2004.

Required Action:

    Coordinate upgrading your site's McIDAS-X and -XCD systems according to your needs. In particular, see Compatibility with -X Remote Servers and -XCD for items that may impact your decision on when to upgrade to -XCD 2004.

Installing McIDAS-XCD

If you need assistance with the upgrade send email to <support@unidata.ucar.edu>.

Required Action:

    Obtain and install McIDAS-XCD 2004 using the instructions in the Unidata McIDAS-X Users Guide.

McIDAS-XCD Changes

This section lists the changes made to McIDAS-XCD since the last upgrade (version 2003) and the Required and Optional actions to perform immediately after installing McIDAS-XCD 2004.

SAO/METAR Stations

The total number of SAO/METAR stations has increased beyond the prior maximum limit of 6500. Complete the required actions below to increase the maximum number of SAO/METAR stations to 7000.

Required Actions:

    Complete the four steps below prior to starting -XCD.

    1. Login to the McIDAS-XCD workstation as user mcidas.

    2. Edit the configuration file ~mcidas/workdata/ISFCDEC.CFG and change its value for NCOLS from 6500 to 7000.

    3. Start a McIDAS session.

    4. Rebuild the rapid access pointer file for surface data.

        Type: BILDTEXT INIT SAOMETAR.RAP SAOMETAR.RAT 7000 4 C4 36 1 80 SAOMETAR X 48


GFS Grid Labeling

The following actions need to be completed.

Required Actions:

  1. Change the real-time grid configuration file so that all GFS (formerly AVN/MRF) grids will be filed into the same grid file range.

    1. Edit the file ~mcidas/data/RTMODELS.CFG

    2. Delete or comment out the line beginning with MRF=

    3. Change the line that begins with AVN= so that it begins with GFS=

    4. Save and close the file

  2. Login as user mcadde and create a dataset named RTGRIDS/GFS.

    Note: This procedure will retain the old datasets (RTGRIDS/AVN and RTGRIDS/MRF) so that your users will not have to switch to the new dataset (RTGRIDS/GFS) immediately. When all of your users have switched to the new dataset you may delete the old ones.

    1. Edit the file ~mcidas/workdata/RESOLV.SRV

    2. Copy the line that begins with N1=RTGRIDS,N2=AVN and paste it directly beneath the original line

    3. In the line you just added, change N2=AVN to N2=GFS

    4. Find the line that begins with N1=RTGRIDS,N2=MRF and change the grid file range to that of the new line containing N2=GFS

      The resulting lines should be similar to these:

      N1=RTGRIDS,N2=MRF,TYPE=GRID,RT=Y,K=GRID,R1=5701,R2=5900,C=Real-Time MRF Grids,
      N1=RTGRIDS,N2=AVN,TYPE=GRID,RT=Y,K=GRID,R1=5701,R2=5900,C=Real-Time AVN Grids,
      N1=RTGRIDS,N2=GFS,TYPE=GRID,RT=Y,K=GRID,R1=5701,R2=5900,C=Real-Time GFS Grids,

      Note that all three of these datasets point to the same grid file range.

    5. Save and close the file.


GFS MOS Stations and Fields

The following actions need to be completed.

Required Actions:

    1. Start a McIDAS-X session under the mcidas account, then register the new GFS MOS MD file schema.

        Type: SCHE DCGFSMOS

    2. Run the command below from a McIDAS-X session under the mcidas account to delete files GFSMOS.RAP and GFSMOS.RAT and create a new GFSMOS.RAP file. The new GFSMOS.RAT file will be created as soon as the next GFS MOS message is received.

        Type: BILDTEXT INIT GFSMOS.RAP GFSMOS.RAT 2000 2 C4 2 12 80 GFSMOS X 48

    3. Edit the file ~mcidas/workdata/GFSMOS.CFG and change the value for NCOLS to 2000 and the value for NROWS to 42. This change increases the maximum number of GFS MOS stations that can be written to the GFS MOS MD file and increases number of forecast periods.

    4. Delete or move the current day's GFS MOS MD file. You must do this because the updated GFS MOS decoder will try to write to the MD file using the updated schema, which contains the new Snowfall Amount (SNW) field. MD files that were created using the previous version of the schema do not contain this field.


ETA MOS Stations and Fields

The following actions need to be completed.

Required Actions:

    1. The ETA MOS configuration file must be updated so that data from new ETA MOS stations will be decoded. To do so, edit the file ~mcidas/workdata/ETAMOS.CFG and make the following changes.

      1. Locate the line WMO=FOUS and change it to WMO=FOUS FOAK FOPA

      2. Locate the next line MINPRD 44 and change it to MINPRD 44 47 40

      3. Locate the next line MAXPRD 49 and change it to MAXPRD 49 49 40

      4. Locate the line NROWS=38 and change it to NROWS=42

      5. Locate the line NCOLS=1400 and change it to NCOLS=2000

    2. Start a McIDAS-X session under the mcidas account, then register the new ETA MOS MD file schema.

        Type: SCHE DCETAMOS

    3. Run the command below from a McIDAS-X session under the mcidas account to delete files ETAMOS.RAP and ETAMOS.RAT and create a new ETAMOS.RAP file. The new ETAMOS.RAT file will be created as soon as the next ETA MOS message is recieved.

        Type: BILDTEXT INIT ETAMOS.RAP ETAMOS.RAT 2000 2 C4 2 12 80 ETAMOS X 48

    4. Delete or move the current day's ETA MOS MD file. You must do this because the updated ETA MOS decoder will try to write to the MD file using the updated schema, which contains the seven new fields. MD files that were created using the previous version of the schema do not contain those new fields. (Note: You can determine the file range for your ETA MOS MD files by the value for MDF in ETAMOS.CFG.)


RTGRIDS Default Dataset Configuration

A new optional dataset naming configuration for real-time grids is included in this upgrade.

Optional Action:

    Switch to the use of RTMODELS.CFG.2004 (located in ~mcidas/mcidas2004/data) in place of RTMODELS.CFG if you want to implement its dataset names and file locations. Installing it is optional because sites are free to choose their own dataset names and file locations.

Source Modules

The table below lists changes to McIDAS-XCD source modules since the previous upgrade (version 2003).


File name Modification

m0dcdsfc.for changed country code for Canada from CN to CA
m0etamos.for added 7 new fields and increased forecast hours by 12
m0gfsmos.for added Snowfall Amount field and fixed several bugs
m0mdrdec.for added Generating Process ID to mcrtgdf call
m0pirdec.for removed check for KTS in wind speed decoder
m0saodec.for increased maximum number of stations from 6500 to 7000
mccmpgrd.for added Generating Process ID to list of criteria used to determine if two grid headers are considered equivalent
obtgserv.c increased size of two arrays to fix memory allocation errors that occurred with large data requests
sigco.pgm added SIGCO ADD ALL and SIGCO DEL ALL options; changed country code for Canada from CN to CA in the initialization subroutine; changed some array declarations to eliminate compiling problems on Solaris 9 for Intel


Data Files

The table below lists changes to McIDAS-XCD data files since the previous upgrade (version 2003).


File name Modification

ETAMOS.CFG added OCONUS WMO headers; changed number of rows from 38 to 42 and number of columns from 1400 to 2000
gbtbpds001.av1 added model #99 (Significant Height of Wind Waves) and model #191 (Current Icing Potential); changed all AVN and MRF references to GFS
GFSMOS.CFG changed number of rows from 38 to 42 and number of columns from 1400 to 2000
GRIBDEC.CFG increased value for SEARCHBACK from 400 to 5000 so that all grids in a grid file will be searched for matching headers
ISFCDEC.CFG increased number of columns from 6500 to 7000
_mcidasxcd.mk set ETAMOS.CFG and GFSMOS.CFG so that they are copied to ~mcidas/workdata only during a new installation
MDRDEC.CFG set default behavior for MDR decoder to use RTMODELS.CFG to determine the grid file range
NEXRID.CFG updated version and date
NOGRIB.CFG set default behavior for grid decoder to decode all grids
RTGRIDS.TXT new data file that describes new RTGRIDS default dataset configuration
RTMODELS.CFG new default grid dataset configuration
xcd_init updated version number
XCD.BAT removed redirection command for RTMODELS.CFG
XCDADDE.BAT changed DSSERVE commands to conform to new default RTGRIDS dataset configuration
XCDDEC.BAT removed REDIRECT REST XCD command
XCDDEC.VER updated version number and date

 
 
  Contact Us     Site Map     Search     Terms and Conditions     Privacy Policy     Participation Policy
 
National Science Foundation (NSF) UCAR Office of Programs University Corporation for Atmospheric Research (UCAR)   Unidata is a member of the UCAR Office of Programs, is managed by the University Corporation for Atmospheric Research, and is sponsored by the National Science Foundation.
P.O. Box 3000     Boulder, CO 80307-3000 USA     Tel: 303-497-8643     Fax: 303-497-8690