![]() |
![]() |
| Community Newsletter | |
Table of Contents
Unidata's New Contracts for Databy David Fulker, Unidata Program DirectorAs most of you already know, two well-known firms, Alden and WSI, were selected as the awardees for contracts to inject real-time weather data products into the Internet Data Distribution (IDD) system for use by Unidata universities. Alden will handle Family of Services (FOS) data, and WSI will inject NEXRAD Information Dissemination System (NIDS) products, both employing Unidata software. Unidata universities have worked with Alden to acquire FOS data since 1985, but most universities heretofore have not had access to NEXRAD data, so important new education and research opportunities seem likely to arise as the new agreements are implemented. Furthermore, as FOS data formerly were conveyed via satellite transmission, use of Internet as the distribution medium represents a major architectural change in the Unidata system. Both WSI and Alden have been enthusiastic in committing themselves to collaborate with Unidata toward effective use of the Internet in this capacity. At the same time, both offer alternative means of data delivery for colleges and universities where sufficiently capacious or reliable Internet connections are unavailable. IDD SchedulesAlden and WSI are participating in our IDD test effort, installing computers with Unidata (LDM) software, relaying data to other test participants, and keeping records that permit us to measure the reliability and speed of end-to-end data delivery. This testing period involves a number of software and configuration changes as problems are diagnosed and possible solutions are tried. If the tests are successful within the time frame we have planned, full-scale deployment of the IDD system (beyond the initial test sites) will begin by fall and require a year or so for completion.In other words, our target for nearly universal IDD system use is the fall semester of the 95-96 academic year, by which time any university may choose to acquire FOS or NIDS via Internet. (A corollary is that your budgets should anticipate continued reliance on other mechanisms for receiving FOS data, such as by satellite or by FTP, through calendar year 1995, and maybe longer if your site has questionable Internet connectivity. See the article on Alden's upcoming change to a Ku-band satellite system on page 11.) Those of you requiring reliable access to NIDS prior the the 95-96 academic year should contact WSI to discuss alternative means for acquiring the needed data. Data Usage IssuesAlthough Unidata's agreements with both Alden and WSI envision Internet as the principle means of data delivery, the two differ greatly in respect to costs and usage permissions. Under the new Alden contract, universities will pay nothing to acquire FOS data via the Internet; in contrast, only those Unidata universities that have paid WSI for a specific subscription (the costs for which will be limited by the Unidata-WSI contract) can access NIDS data via the Internet. Eventually, the effect of this will be to reduce the aggregate university expenditures for FOS data by roughly $200,000 per year, but interest in NIDS may prevent Unidata universities from actually lowering their data acquisition budgets.There also are differences in how FOS and NIDS may be employed by Unidata universities: the Alden contract allows significant flexibility, such as for redistributing FOS data to K-12 schools, while the WSI agreement limits use to the campus and imposes other constraints which we believe are reasonable in the light of current National Weather Service policies on NIDS. Let's look at each contract in more detail.
The Contract with Alden for FOS DataUnder the new contract, Alden has agreed to provide Unidata universities with access to all FOS data, with the exception of DIFAX, at no cost to the universities. (All costs associated with the data are being assumed by the Unidata Program Center.) In negotiating this agreement, Unidata obtained broad permission for research and educational use of these data. Specifically, the contract reads:"No restrictions will be placed on the use of FOS data--over and above those imposed by law or NOAA policy--which will restrict Unidata Universities from using these data in educational and research endeavors that are customary for such institutions."The agreement further notes that the current use of FOS data at various Unidata universities includes: FOS usage for purposes that are neither education nor research oriented fall outside the scope of this agreement and must be negotiated directly with Alden. Data covered by this agreement include the Domestic Data Service, the Public Product Service, the International Data Service, and the High Resolution Data Service (the output from the National Meteorological Center models; this service was formerly called the Numerical Product Service). As noted above, access to DIFAX products is not included. For contract information on FOS Data Usage contact the Unidata Program Administrator. For product information contact Alden Electronics at 1 800 225-9492. The NIDS-Data Contract with WSIThe contract with WSI, which covers access to NIDS products, is more restrictive than the Alden contract. In many respects the new WSI contract is similar to the now-lapsing contract with Alden for data broadcast by satellite: each university has a license with WSI, each university subscribes to those products it desires, and the universities pay the costs for their subscriptions. The agreement stipulates ceiling prices for certain types of subscriptions and (unlike the old Alden contract) it specifies that NIDS data must be accessible to users via Internet through use of Unidata's LDM software. The contract also covers other aspects of data-service provision, and it defines a few types of data usage that are permitted.The WSI contract provides that where the data are employed only on campus and only for educational, noncommercial purposes, and where the Unidata University puts forth its best effort to inform users of this requirement, the following uses are permitted:
The on-campus restriction is not imposed on data that are more than 48-hours old. Other uses, such as in K-12 settings or state networks, may be permitted on a case-by-case basis separately negotiated with WSI. The exact terms and conditions will be based upon the desired use of the data, access controls, and so forth. Readers should note that their universities' agreements with WSI will provide the definitive statements on costs and appropriate usage. The Unidata contract provides a framework within which we believe most universities (individually) can reach such agreements economically and with reasonable usage permissions, but Unidata will not play an arbitrating or interpreting role. And to the extent that a university negotiates usage permissions outside the framework defined above, subscription costs may exceed the Unidata ceilings.
Upcoming Dates to RememberHere's a short list of important dates that will affect all Unidata sites during the IDD deployment process:
Establishing the IDD Deployment ScheduleIt starts with your survey.As you should now know, Unidata's Internet Data Distribution (IDD) system is being field tested. Deployment of the system is scheduled to begin September 1, 1994. At this point, we anticipate it will take one year to bring the bulk of our sites online.In order to help plan how the system will be deployed, the UPC has sent a questionnaire to every Unidata site via the community mailing list. The survey information will be vital in determining the order in which sites are added to the IDD system. Sites which don't provide the survey information will necessarily be brought online late in the deployment. As you should now know, Unidata's Internet Data Distribution (IDD) system is being field tested. In developing the deployment schedule, the UPC will consider a number of factors., such as:
Internet Data Distribution PrinciplesEditor's note: In April, Dave circulated this document via email to Unidata's Advanced Technical Advisory Committee for comment. The continuing discussion that this draft has stimulated is provocative, and Dave would appreciate further comment from the community at large. You should send your comments to Dave via email as soon as possible, since this document will be discussed at the next Policy Committee meeting June 28 and 29. by David Fulker, Unidata Program DirectorThe Internet Data Distribution (IDD) system is a means by which Unidata universities can build and keep current their holdings of environmental data, especially those updated in near-real time. IDD is a "distributed application," with interacting components (data sources, data relays and data sinks) at many locations nationwide. Responsibilities for running and maintaining the IDD system also are distributed, on the assumption that proper balances among cost, data needs, performance and flexibility are best achieved through community effort--organized and guided by the Unidata Program Center (UPC)--rather than a more centralized endeavor. Elaborated in subsequent sections are eight key principles that reflect the above purpose and underly the IDD system design:
NIDS: What's Included, What It Costsby Linda Miller, External Programs Coordinator at the Unidata Progam Center Under Unidata's contract with WSI, Unidata universities may receive a range of NIDS products (see "Can I use NIDS data for _____? " for information on how these data may be used). WSI has grouped the products into four types of service, and Unidata has negotiated a ceiling price for each option. There are six subscription options, outlined in Table 1.
*******************************************************************************
Table 1: Data delivery services available from WSI
under the Unidata contract
SERVICE DESCRIPTION COST CEILING
-------------------------------------------------------------------------------
Tier I The entire suite of products from one NEXRAD $100/month
site at a designated location
-------------------------------------------------------------------------------
Tier II The entire suite of products from a single $175/month
(changeable location) NEXRAD site
-------------------------------------------------------------------------------
Tier III The entire suite of products from all NEXRAD $575/month
sites
-------------------------------------------------------------------------------
Tier IV A special floater service featuring NIDS $50/month
products. A Unidata designee selects up to three
sites where severe weather is occuring. (This is
an optional add-on to Tiers I and II; it cannot
be purchased separately.)
-------------------------------------------------------------------------------
NEXRAD Mosaic A high-quality mosaic created using both auto- $195/month
mated processing techniques and manual valida-
tion and which includes relevant WSR 57/74 radars
as well as WSR-88D
*******************************************************************************
NIDS productsThe NIDS products, unaltered in data content, are the same in all four tiers. NIDS products represent selected information from the Level III database from each NEXRAD site. Many of these data will be archived and available at the National Climatic Data Center (NCDC) in Asheville, NC. Level III data will have a wide range of applications, including meteorological research, studies of important weather events, and input for meteorological models. These data also contain the radar-derived estimates of precipitation accumulation for input on hydrological and runoff models.Tables 2a and 2b, reproduced from the July 93 Bulletin of the American Meteorological Society, list the specifications for products available from WSR-88D systems. (Note: these tables are roughly 8 by 10 inches in size.) WSR-88D data levelsLevel I data are the analog, time-domain output of the receiver, used primarily for detailed engineering work; there are no plans for recording these. Level II data are the digital base data output from the radar data acquisition system's signal processor in polar format. These data have not been processed by the meteorological and hydrological analysis algorithms. Level III data are the base products and products derived by the radar product generation component. These data vary according to convective activity.Table 3 (approx. 8 by 10 inches) lists the Level III products in clear-air and precipitation modes from each WSR-88D system. Data archiveLevel II data will be collected at selected WSR-88D sites to support the development of the systems. NCDC will archive these data. Level III data, containing the products of the meteorological algorithms executed in the Radar Product Generator, will also be accessible there. The Radar Data Archive Service Center, located at the University of Oklahoma, will be a backup to NCDC and provide value-added services.Be preparedIn considering the level of service you subscribe to, remember that capturing and storing these products will require considerable disk space. Unidata's limited experience thus far suggests that a single radar generates 30-35 MB of data per day (contingent upon weather events).Good News! Wind Profiler Network is Back from the Deadby Linda Miller, External Programs Coordinator at the Unidata Program CenterThere are no longer any plans to cease operation of the Wind Profiler Demonstration Network (WPDN) in October 1994. In a National Research Council meeting on the National Weather Service (NWS) modernization in Boulder, Colorado on May 25, Bob Landis, Assistant Administrator for Operations of NWS, and Alan Thomas, Director of NOAA's Environmental Research Laboratories, announced that the WPDN would continue to operate during FY1995. In addition, the network has already been budgeted for FY1996. Ku Band and Other Options for FOSEditor's note: In mid-May, Alden Electronics informed the Unidata community of its decision to upgrade its satellite broadcast system from the current C-band system to a Ku-band system. The upgrading process is scheduled to begin in July. As the letter noted, sites leasing C-band equipment from Alden will have the equipment replaced at no cost; sites owning their own equipment would need to replace it at their own expense. This decision has caused some consternation within the community. Below are two responses to these concerns. by Dave Fulker, Unidata Program DirectorIt must be painfully evident to most of you that the timing of upcoming changes in the Family of Services (FOS), and the resultant equipment upgrades needed for continued receipt of these data from Alden, is problematic in relation to Unidata's transition to Internet data delivery. My purpose here is to illuminate the problem and clarify your options for coping. I begin by describing the situation we face:
At the Unidata Program Center, we have wrestled hard with this problem and considered many alternatives, including:
Therefore, the options available appear to be as follows:
Note to DIFAX users: Options 2 and 3 both allow continued access to DIFAX. The IDD may eventually deliver DIFAX, as suggested in the following note from Alden, but we do not know when this service will become available. I hope you find this information helpful, and I beg your patience as we put forth our best effort to construct a reliable IDD system that will deliver FOS and Wisconsin data at no cost to universities beyond that of maintaining a good Internet connection. By a good connection, I mean one with sufficient capacity to meet your own needs and to allow you to be a good neighbor, relaying data to other members of our community. Some Information from Alden on the FOS Upgradeby Edie Arbetterm, Alden Electronics, Inc.Alden has prepared the following information in a question-and-answer format. This information is about the FOS upgrade and Alden's choice of new technology to support this upgrade. Q: Why is Alden upgrading the satellite receiving equipment? A: At an NWS-sponsored meeting in January of this year at the American Meteorological Society Conference, Alden was told that the NWS would upgrade the FOS data rates. The current rates of the International Data Service (2.4 Kb/s), Public Products Service (2.4 Kb/s), and Domestic Data Service (2.4 Kb/s) would all be increased to 9.6 Kb/s. The NWS decided that this increase was required because the data at peak loading times was exceeding a predetermined value, and traffic was backing up an unacceptable amount. This increase in data rates is a three-fold increase and requires a sizable addition to the bandwidth required to broadcast the data via satellite. The current receivers, which lasted more than 10 years, and used to receive the data on both C-band and Ku-band, are not upgradeable to support the higher data rates mandated by the NWS. Alden has chosen state-of-the-art technology that should meet your data needs going forward. Each channel and receiver data port can handle up to 512 Kb/s. Q: What effect will this upgrade have on me and my equipment? A: The answer will depend on a number of factors:
Our customer representatives will contact you about your equipment needs to evaluate the most time- and cost-effective way to do the upgrade. Q: Will the fees charged for data streams be changed? A: Alden is not planning to change the current fee schedule for the data streams at this time, unless you are not being charged at our current prices. Q: What technology has Alden chosen? A: The FM3 technology was chosen because it is the most cost-effective method of transmitting the data to you, our customer. With this new technology we will be able to continue to provide you with low-cost, highly reliable data services. The new system will use FM3 technology. This technology is proprietary to Space Com Systems, Inc. It is a term they use for their broadcast of data using a time-division multiplexing scheme. The current technology utilizes frequency- division multiplexing for its transmission method. This new FM3 technology uses Ku-band exclusively as the transmission medium, which is the reason that the C-band users must transition to Ku-band. The new receiver will be 15 in. x 10 in. x 1.75 in. This receiver will have the capability to receive one or two data streams. An expansion chassis will be offered that will allow a customer to receive up to eight additional data services. This brings to ten the number of data services that one customer may receive without buying a new receiver. Another benefit is that the incremental price to upgrade to a new service is very reasonable. Q: When will the Internet Data Distribution (IDD) be a reality? A: Our Unidata partners are predicting that the IDD will be ready at this time next year. Alden must respond to the NWS upgrade of the FOS data rates, as the old data rates will no longer be available after November 1994. Alden is taking this opportunity to put in place state-of-the-art technology. This upgrade will satisfy the data transmission and reception requirements well into the future. Q: Will the High Resolution Data Service (HRS) increase in baud rate? A: The NWS is in the process of determining if they have the capability to increase the HRS data stream to 56 Kb/s. This increase will be the second in a one-year period for the HRS data stream. The last change in this data stream was from 4.8 Kb/s to 19.2 Kb/s. When this change took place, Alden changed the format from synchronous to asynchronous so it would not be necessary to purchase expensive hardware to receive this type of data stream. Right now, we must await the decision of the NWS as to the increased baud rate on HRS. The impetus for the change to this data stream is to accommodate the new Rapid Update Cycle products expected to be available in the late fall or early winter of this year. To prepare for this potential increase to 56 Kb/s, Alden would like to hear from all of its HRS customers as to their preference should this increase take place. Would you like to see us maintain a 19.2 Kb/s service by leaving out the new products? Would you like to see 56 Kb/s service with all the new products? Are there other alternatives to consider? Please relay your thoughts to your customer representative. Q: Will my equipment be able to ingest the data at the higher baud rates? A: The answer to this cannot be universal. Many factors will decide if the hardware/software products you are using to receive/display the information will accommodate the new and increased data rates. Alden is vigorously pursuing answers to these questions and your customer representatives can discuss your particular needs with you. Q: Will D+ be available and what will the data rates for this service be? A: Alden will continue to support D+. The baud rate for this service will increase from 4.8 Kb/s to 19.2 Kb/s. Q: The system that Alden is now using is broadcast on both C-band and Ku-band. We understand that the new system will only be on Ku-band. Can you tell us why you are changing and what impact this will have on our reception? We are especially concerned about rain fade. A: Both broadcast technologies--C-band and Ku-band--have problems with reception under certain conditions. C-band reception is more susceptible to terrestrial interference than is Ku-band. This makes using C-band more difficult in areas where there may be a lot of interference, as in large cities, for example. Ku-band equipment does not suffer from this interference problem, but does suffer from rain fade. Neither system is perfect. FM3 is an improvement over FM2 in the Ku-band transmission. The technology used in the FM3 lessens the impact of rain fade by using a higher powered signal to blast through the rain column. This provides a usable signal to the receiver for a longer period prior to and just after the heaviest rain fade occurs, so that the amount of time you are experiencing rain fade is minimized. Also, Alden has chosen to provide a 1.2-meter dish versus a standard .75-meter dish to improve the signal strength to the receiver to minimize rain fade. The average customer will experience rain fade on the order of minutes out of a year. Q: Where is the new satellite relative to our existing satellite? A: If you are currently a Ku-band customer there will be no change in the antenna pointing. The same satellite will be used for both technologies. If you are a C-band customer, the new satellite is located at 99 degrees longitude versus the C-band satellite that is at 87 degrees longitude. Customers in the eastern half of the US must point their antennas slightly (less than 10 degrees) below the current angle; those in the western part of the country will need to make only small changes (a degree or two). Q: What is the schedule of significant events? A: The following is a list of significant events as currently planned for action by Alden:
Our customer representatives are here to help. You will be hearing directly from them, but meanwhile, if you have a question, call them toll free at 800-225-9492. Alden Electronics, Inc. WetNet Products Available through Unidata BroadcastThe WetNet project began in 1989 at NASA's Marshall Space Flight Center as a prototype interdisciplinary, interactive, data-analysis and research project devoted to the study of the global hydrologic cycle. The project has been distributing microwave satellite data to 45 scientists worldwide via magneto-optical cartridges and a daily Internet broadcast.WetNet's data are from the polar-orbiting SSM/I (Special Sensor Microwave/Imager) on the Air Force's DMSP (Defense Meteorological Satellite Program) satellites. WetNet produces brightness temperatures from the instrument's seven channels in both full-resolution "swaths" and reduced-resolution, global-composite "browse" images. There are also seven derived geophysical products produced daily in the browse format. These are rain rate, total precipitable water, cloud liquid water, marine wind speed, land classification, land surface temperature, and sea-ice fraction. WetNet will be making all of these products (except rain rate) available to the Unidata community through the Unidata/Wisconsin channel broadcasts. For more information on the WetNet project, read "The WetNet Project," to be published in Remote Sensing Reviews, Volume 11 (in press). Can I use NIDS data for ____________?WSI clears up the picture.The Unidata Newsletter posed a number of questions to WSI in an attempt to clarify how NIDS data may be used. Here are WSI's responses:
|
|
Please send comments to info@unidata.ucar.edu |
|