Policy Committee Meeting Summary
15-16 October 1998

Arlington, VA


Participants

Members Representatives
John Merrill (Chair) David Carlson (NCAR/ATD)
Ken Crawford Harry Edmon (ATAC)
Robert Fox David Fulker (UPC)
David Knight Mary Glackin (NOAA/NWS)
Colleen Leary Bernard Grant (NSF/ATM)
James Moore Clifford Jacobs (NSF/ATM)
Charles Murphy Jennie Moody (U.VA./Users)
George Serafino (NASA/Goddard DAAC)
UPC Staff
Sally Bates
Ben Domenico
Joanne Graham
Jo Hansen
Linda Miller
Russ Rew


Administrative Matters

Status Reports

Director's Report and the Budget Report

Copies of Fulker's and Graham's slides were distributed at the meeting. In addition to his status report as given in the slides, Fulker noted that he'd made a presentation to the AMS Heads & Chairs on Unidata's Java transition and that it had been well-received. He also reported on receiving his medal from Educause/AMS .Graham gave the budget presentation, discussing FY98 year-end, FY99 planning, soft money status, and the resubmission of the 2003 proposal. She offered three scenarios for future funding to Unidata and discussed the implications of each.

Discussion:

Users Committee Report

Copies of the Users Committee Meeting Summary are in the notebook. Moody noted that the meeting opened with Mohan Ramamurthy passing the Unidata chairman's bell to Moody. She then quickly summarized the meeting. The resolutions resulting from the meeting were on the Policy Committee agenda and there was no discussion.

NASA Report

George Serafino introduced himself, and commented on the noticeable lack of interactions between Unidata and NASA--a situation that Serafino hopes to remedy. He then explained that the Goddard Distributed Active Archive Center (DAAC) is customer-oriented. It is composed of three groups: customer support (Serafino's group), engineering support, and data management. The DAAC handles a range of data including such legacy sets as TOMS and Pathfinder, and some newer data sets (SeaWIFFS, TRMM); the DAAC will also archive AM-1 MODIS data (scheduled for launch in 1999), which may reach volumes of 650 TB/day. On new data sets, there is a two-day time-lag between observation and the release of the data (the same lag will apply to MODIS data). He noted that NASA has discovered that for most of its users, ease-of-use and ease-of-access are of paramount importance; thus, instead of relying strictly on nearline data access to large HDF files, they provide single-parameter flat files online that may be conveniently downloaded and interpreted using simple, DAAC-supplied readers that run on multiple machines.

Discussion:

Action 1: Serafino will check with George Huffman to see whether the Goddard DAAC group is archiving any of the NCEP data.

NOAA Report

Mary Glackin introduced herself and noted that Doug Sargeant (the committee's former NOAA representative) had passed on to her his shelf of information on Unidata. Glackin reported on four topics: NOAAport/FOS, WMO Resolution 40, NIDS, and N-AWIPS.

Concerning NOAAport, Glackin reported that the agency is engaged in an end-to-end test of the system's reliability and that it expects to announce at the annual AMS meeting that the system is operational. The agency is still adding FOS products, changing headers, adding gridded data (she expects NOAAport to carry more gridded data than FOS), and that current information on all of this is available on the Web.

Concerning WMO Resolution 40, Gen. Kelly has announced that, as of 31 October 1998, all international data received by NWS will be placed on the Web, but that a caution window will appear when a user selects these data, specifying that their use is restricted to education and that the data may not be redistributed. NWS will log the addresses of users accessing those pages. She also noted that there has been no official response from the countries most concerned about this action, only an "expression of dismay."

With respect to NIDS, the National Weather Service has established a requirement for the central collection of radar data to support numerical modeling efforts. Given a formal requirement, the NWS will be pursuing options to meet this requirement. The current NIDS arrangements are not acceptable for this purpose. Given this, the NWS has informed the NIDS vendors that the current agreements will not be renewed, but has requested to extend the current agreements 12-18 months to provide a transition to a new method of collecting and distributing NIDS data. The NWS is exploring several avenues for distribution: some of these data will be on NOAAport and some may be distributed using Internet push technology. The agency is required to send WFOs data from their local radars, but there will be no guarantee that these data will match exactly what the WFOs are currently receiving from the NIDS vendors.

Concerning N-AWIPS, Gen. Kelly has directed Glackin to specify an evolution of AWIPS to encompass N-AWIPS capabilities; a design team is currently examining what this might entail, but they do not intend to port the GEMPAK/N-AWIPS code to AWIPS. In the meantime, N-AWIPS is needed to interface with legacy software packages that are not Y2K compliant, so NWS will continue enhancing N-AWIPS for the coming year. By mid-1999, Glackin noted, N-AWIPS will still be in use at national centers, but it will no longer be in use at WFOs. Gen. Kelly is aware of the broader university concerns about the loss of N-AWIPS, but she noted that the commonalities between universities and WFOs have already been disrupted.

Resolution 1: The Policy Committee expresses its appreciation to Doug Sargeant (NOAA) for his long and highly constructive service to the Unidata Program and the community of Unidata users through his participation on the Policy Committee. (Passed unanimously.)

Discussion

Action 2: The UPC will send a letter to the community explaining the upcoming changes to the NWS NIDS contract; an article on this should also appear in the next issue of the newsletter.

Action 3: Glackin will determine what the plans are for distributing a national mosaic of radar data.

Action 4: The UPC will develop a plan for advising users on how to comply with NWS international data restrictions, identifying the costs involved, and report on this at the next Policy Committee meeting.

NSF Report

Copies of Cliff Jacobs' slides were distributed at the meeting. Jacobs focused primarily on KDI. He reported that the award process was sufficiently flawed that he could not recommend Unidata submitting another proposal to KDI. Bernard Grant reported on the distribution of equipment grants. He noted that the amount requested ($404,144) was unusually large because one proposal requested $100,000 in a series of tear-off proposals and another contained no cost-sharing provisions.

Discussion

The Future of GEMPAK

At its September 1998 meeting, the Unidata Users committee expressed its appreciation for GEMPAK, particularly the ease-of-use brought to the software by the GARP interface. The committee expressed concern about the future of GEMPAK (N-AWIPS, N-MAP, and GARP) and asked that Fulker work with members of the committee to draft a letter to Gen. Kelly expressing these concerns. The software is widely used in the university community. The software also represents a point of commonality between universities and the WFOs. Fulker noted that the UPC staff would like to be able to employ GEMPAK ideas in the Java software now under development by Unidata.

Discussion

Action 5: Fulker will draft a letter to Gen. Kelly expressing an interest in being kept informed of N-AWIPS developments. The letter should indicate Unidata's awareness of NWS priorities.

Action 6: Fulker will look into obtaining a release of GARP from COMET.

Resolution 2: The Policy Committee recognizes the Users Committee's concerns regarding the future of GEMPAK/N-AWIPS and will make every effort to ensure that the functionality of this software is not lost to the community. The Policy Committee further recognizes the Users Committee's interest in maintaining some level of software commonality between the university and forecasting communities. (Passed with one abstention.)

Access to Retrospective Data

At its September meeting, the Users Committee passed the following resolution:

Users Committee Resolution 2 (passed unanimously):

In agreement with the recommendation by the NSF review panel, the Users Committee recommends that the Unidata Policy Committee explore Unidata collaboration with other agencies and organizations (e.g., NCAR SCD) to facilitate access to archived meteorological data in forms compatible with Unidata-supported software.

The Users Committee is particularly interested in having "easy" access to a data stored by SCD. Essentially, Moody explained, the Users Committee agreed with the NSF Review Panel's Recommendation 3:

Recommendation 3

The panel recommends that the UPC, in its development in general, work with UCAR entities and institutions in the development of tools and infrastructure that will facilitate access to remote historical archives. The panel feels that the two retrospective data sets of most interest to the university community are digital satellite and radar data. Additional data sets to consider are the daily climatic values from the National Climatic Data Center (NOAA) and the daily hydrologic values from the Water Resources Division (WRD) of the U.S. Geological Survey (USGS).

Moody noted that the NSF Reviewers' recommendation and the Users Committee resolution, when combined, identified a broad community need for access to archival data. Moody further noted that the committee recognized that this was not a task for the UPC.

Discussion

Action 7: Fulker will prepare for a more focused discussion at the next meeting; the topic will be data access and software compatibility , and an SCD representative will be present.

Action 8: Fulker will contact Dan Atkins (UARC), the NASA DAACs, and IRIS about concepts involved in facilitating access to retrospective data.

Action 9: Before the next meeting, the Policy Committee members will reflect on the relative priorities of accessing retrospective data vs other advancement projects.

Sense of the Committee:

The Policy Committee strongly supports Fulker's actions to bring a focus to discussions about access to retrospective data. A goal of this effort is to produce a white paper that can be used in discussions with other disciplines and agencies.

Unidata's Response to the NSF Panel's Reviews

Unidata's response to the NSF Panel Reviews had to be redrafted due to the NSF budget realities delineated at the last Policy Committee meeting. This agenda topic provides the committee with an opportunity to comment on the response.

Discussion

Platform Support Issues

At its last meeting, the Users Committee passed the following resolution:

Users Committee Resolution 1 (passed unanimously):

The Unidata Users Committee endorses the following changes in Unidata's platform support:
A. Immediately sunset support for ULTRIX and SunOS 4.x.
B. Add support for Red Hat Linux and Solaris for Intel (x86).
C. Sunset support for OS/2 on July 31, 1999.

Discussion

Resolution 3: The Policy Committee adopts the following changes in Unidata's platform support as recommended by the Users Committee:

A. Immediately sunset support for ULTRIX and SunOS 4.x.
B. Add support for Red Hat Linux and Solaris for Intel (x86).
C. Sunset support for OS/2 on July 31, 1999.

(Passed unanimously)

Outstanding Participation Award

Sally Bates explained that the procedures for this award as passed by the Policy Committee results in few (if any) people being eligible for the award. Active participants remain active on committees and hence remain ineligible. In response to this impasse, the Users Committee passed the following resolution:

Users Committee Resolution 3 (passed unanimously):

The Users Committee requests the Policy Committee give the Users Committee full authority for making the Russell DeSouza Award. Current Users Committee members will be excluded from consideration. The Users Committee will seek nominations from the community, discuss the nominations in an open meeting, and render its decision in executive session.

Resolution 4: The Policy Committee gives full authority to the Users Committee for making the Russell DeSouza Award. (Passed unanimously.)

Unidata Membership Policy

Fulker noted that Unidata has participants, not true "members." The UPC does track software licenses and there are rules that restrict data usage, as required by Unidata's contracts with data vendors and the WMO Resolution 40 policy on the redistribution of additional data (see http://www.nws.noaa.gov/oso/addata.shtml). The issue of membership emerged in the UPC's negotiations with Alden concerning the distribution of NOAAport data. The MOU contains a de facto membership definition: "Unidata may extend the network to all current Unidata participants, to any degree-granting department at a U.S. or foreign institution, to any not-for-profit entity with UCAR, and to any government or not-for-profit organization with which Unidata is collaborating on matters of education, research, software development, or data access." There are no restrictions on who can use the McIDAS software or data streams; the UPC still licenses the software for tracking purposes. People wanting GEMPAK, but not falling within the listed criteria, historically have been referred to COSMIC (which is under transition). This is another reason for wanting to clear up the legal standing of GEMPAK.

Discussion

Communications Structures

Charlie Murphy explained that in the process of reviewing equipment grants, there arose questions as to how well Unidata was disseminating information about platform requirements. (A copy of Murphy's e-mail to Fulker on this topic is in the notebook). Sally Bates noted that this leads to the broader question of whether Unidata is communicating to the community effectively. She noted that the effects of the current restricted budget mostly affects communications structures, as can be seen from Documentation status report (in the notebook), which includes a list of items that have not been accomplished. Even though the UPC cannot accomplish all its former communications tasks, Unidata is exploring opportunities to augment communication based on sharing resources with other UCAR programs. Ben Domenico gave a presentation on what he's calling the Community Object-Oriented Hypermedia Library (COOHL), in which COMET, PAGE, and Unidata cooperate to develop a resources needed by all. One example is a tool for indexing useful resources currently on the web. (A draft explanation on this is available at http://fanny.unidata.ucar.edu/PAGE/CommunityAccess.htm. See also http://www.unidata.ucar.edu/projects/coohl/plans/commplan.html.) Domenico's presentation was followed by a free-form brainstorming session on communications.

Some Comments:

Action 10: Bates will check with Julie Winkler on whether and how to engage the Heads and Chairs in an effort to improve communication.

Action 11: Bates will check out the Tropical Newsletter mentioned by Carlson and Fox.

Action 12: The Policy Committee will revisit this issue next year.

List of Resolutions and Action Items
October 98 Policy Committee Meeting

 

Resolution 1: The Policy Committee expresses its appreciation to Doug Sargeant (NOAA) for his long and highly constructive service to the Unidata Program through his participation on the Policy Committee. (Passed unanimously.)

Resolution 2: The Policy Committee recognizes the Users Committee's concerns regarding the future of GEMPAK/N-AWIPS and will make every effort to ensure that the functionality of this software is not lost to the community. The Policy Committee further recognizes the Users Committee's interest in maintaining some level of software commonality between the university and forecasting communities. (Passed with one abstention.)

Resolution 3: The Policy Committee adopts the following changes in Unidata's platform support as recommended by the Users Committee:

A. Immediately sunset support for ULTRIX and SunOS 4.x.
B. Add support for Red Hat Linux and Solaris for Intel (x86).
C. Sunset support for OS/2 on July 31, 1999.

(Passed unanimously)

Resolution 4: The Policy Committee gives full authority to the Users Committee for making the Russell DeSouza Award. (Passed unanimously.)

 

Action 1: Serafino will check with George Huffman to see whether the Goddard group is archiving any of the NCEP data.

Action 2: The UPC will send a letter to the community explaining the upcoming changes to the NWS NIDS contract; an article on this should also appear in the next issue of the newsletter.

Action 3: Glackin will determine what the plans are for distributing a national mosaic of radar data.

Action 4: The UPC will develop a plan for advising users on how to comply with NWS international data restrictions, identifying the costs involved, and report on this at the next Policy Committee meeting.

Action 5: Fulker will draft a letter to Gen. Kelly expressing an interest in being kept informed of N-AWIPS developments. The letter should indicate Unidata's awareness of NWS priorities.

Action 6: Fulker will look into obtaining a release of GARP from COMET.

Action 7: Fulker will prepare for a more focused discussion at the next meeting; the topic will be data access and software compatibility , and an SCD representative will be present.

Action 8: Fulker will contact Dan Atkins (UARC), the NASA DAACs, and IRIS about concepts involved in facilitating access to retrospective data.

Action 9: Before the next meeting, the Policy Committee members will reflect on the relative priorities of accessing retrospective data vs other advancement projects.

Action 10: Bates will check with Julie Winkler on whether and how to engage the Heads and Chairs in an effort to improve communication.

Action 11: Bates will check out the Tropical Newsletter mentioned by Carlson and Fox.

Action 12: The Policy Committee will revisit the communications issue next year.

Sense of the Committee:

The Policy Committee strongly supports Fulker's actions to bring a focus to discussions about access to retrospective data. A goal of this effort is to produce a white paper that can be used in discussions with other disciplines and agencies.