Unidata is pleased to announce the availability of the Python Data Access Framework (DAF). The DAF provides access to an AWIPS II Environmental Data EXchange (EDEX) server directly from Python code. Created by Unidata Program Center software engineer Michael James, the DAF strengthens Unidata's AWIPS II offerings by making it easier to retrieve data from the AWIPS II data storage system from outside the Common AWIPS Visualization Environment (CAVE).
Users have always been able to request real time NCEP/NWS weather data using AWIPS II, but now, with the addition of the Python DAF, users can request this data using only simple python commands.
Data management mandates from federal funding agencies, professional societies, and publishers are becoming more common at all scales of research effort. To help researchers navigate the new requirements and implement effective, low-overhead data management workflows, Unidata is hosting an AMS Short Course on Data Management Planning and Implementation: Training on available open-source tools and services from the community and Unidata. The short course will be held the afternoon of Sunday, 10 January 2016, preceding the 96th AMS Annual Meeting in New Orleans, Louisiana.
The short course will provide information on the current mandates, present a researcher-focused approach to data management, and introduce freely available services and tools that can be combined to manage and share research data. The course is intended for practicing researchers who are interested in both meeting the current requirements and implementing “best practice” data management processes in their research effort. The course builds on and extends information available in Unidata's Data Management Resource Center.
The Big Data Project (BDP) is an initiative undertaken by the National Oceanic and Atmospheric Administration (NOAA) to increase public availability of large volumes of environmental data collected and generated by the agency. As part of the Big Data Project, Unidata is working in collaboration with Amazon Web Services (AWS) on a demonstration project to provide access to a more than twenty years of archived NEXRAD Level II radar data — augmented continuously with new, real-time data — stored in Amazon's Simple Storage Service (S3) environment. In addition to assisting AWS with ingesting new data flowing from the NEXRAD sites, Unidata Program Center staff have set up a THREDDS Data Server in the AWS environment to provide services allowing community access to the stored data.
The Unidata Program Center (UPC) is searching for atmospheric science researchers or research groups to participate in a pilot project aimed at designing and implementing robust data management workflows. The project aims to assist at least three community partners representing modest research projects of different scales in the implementation of data management processes that satisfy National Science Foundation and other federal funding agency requirements.
Beyond simply satisfying current funding proposal requirements, the project hopes to test effective methods of collecting, transforming, storing, and sharing atmospheric science data. The methods used will be documented and polished for broad community use as examples serving to guide similar projects. If successful, the project will give researchers tools to satisfy funding agency requirements while making their data more widely discoverable, available, open, and usable by others in the community.
Data management mandates from federal funding agencies, professional societies, and publishers are becoming more common at all scales of research effort. To help researchers navigate the new requirements and implement effective, low-overhead data management workflows, Unidata is hosting an AMS Short Course on Data Management Planning and Implementation: Training on available open-source tools and services from the community and Unidata. The short course will be held the afternoon of Sunday, 10 January 2016, preceding the 96th AMS Annual Meeting in New Orleans, Louisiana.
The short course will provide information on the current mandates, present a researcher-focused approach to data management, and introduce freely available services and tools that can be combined to manage and share research data. The course is intended for practicing researchers who are interested in both meeting the current requirements and implementing “best practice” data management processes in their research effort. The course builds on and extends information available in Unidata's Data Management Resource Center.
The HIWPP Open Data Initiative's first Users' Meeting will be held on Thursday, September 10th, from 1:00 to 3:00 pm Eastern Daylight Time. This will be a virtual meeting hosted via GoToMeeting.
The High Impact Weather Prediction Project (HIWPP) is a collaboration between a dozen or more organizations led by the NOAA Office of Oceanic and Atmospheric Research (OAR) Earth System Research Laboratory (ESRL) and the OAR/Office of Weather and Air Quality. Funded as part of the Hurricane Sandy Disaster Relief Supplemental Appropriations, the project aims to improve near term (from “now” to several weeks or months in the future) prediction of dangerous weather events including hurricanes, floods, and blizzards.
National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) model output with 0.25-degree resolution will be added to the Internet Data Distribution (IDD) CONDUIT data stream on July 28, 2015.
Update: GFS 0.25-degree output is now available via the CONDUIT data stream.
NCEP began producing the GFS model output with a 0.25-degree resolution for use in weather forecasting operations in January, 2015. Unidata Program Center staff have tested the 0.25-degree GFS model output internally and have been working with operators of top-level IDD relay sites to ensure that they have the capacity to handle the increased data volume associated with this new data stream. The approximate volume of the 0.25-degree GFS model output is 20 GB per model run, four times each day. For comparison, all of the current GFS model output delivered via CONDUIT (GFS 0.5-degree, 1-degree, and 2.5-degree) total approximately 5 GB per model run, four times each day.
The High Impact Weather Prediction Project (HIWPP) team has announced that output from the experimental, high-resolution NAVGEM model has been added to the HIWPP Open Data Initiative Real-time Data service.
Unidata's demonstration THREDDS Data Server (TDS) at https://thredds.ucar.edu/thredds/ is currently running version 4.5 of the TDS server software. On May 18, 2015, this server will be updated to use TDS version 4.6. Read on for details on the new version and transition options.
The Department of Atmospheric Science at Colorado State University (CSU) has a long history of research and education in all aspects of the atmospheric sciences. Faculty, students, and staff use a wide variety of datasets in their research and teaching, from numerical models to gridded reanalyses to radar and satellite observations to measurements collected in the field and lab. However, the students in the department recognized issues that were preventing these large datasets from being used to their full potential.
With a grant from the Unidata Community Equipment Awards program, along with a grant from the College of Engineering, the CSU Department of Atmospheric Science acquired a data storage server that makes many of these data sources readily and easily accessible to students.
