Re: NOAA/ESRL/GSD DMZ storage maintenance

Status as of 9/24 6:05 pm MDT:

The system is largely up now, and most GSD services have returned. We believe the system will remain available through the evening, albeit with possible short interruptions.

We expect to perform tests and other maintenance procedures in the morning that may result in additional service outages.

For any questions or concerns, please feel free to contact the GSD Systems Support Group at 303.497.6887 or at address@hidden

On Wed, Sep 24, 2014 at 10:33 PM, Systems Support Group <address@hidden> wrote:

Status as of 9/24 4:20 pm MDT:

While we continue to work toward reestablishing the normal operation of the ESRL/GSD DMZ storage system, it has been off-line for the last hour or so. As a result, most externally facing web, ftp and LDM services are from GSD currently unavailable. At this point, we don't have an estimated return time. Sorry. We will provide additional updates when new information is available.

Again, thank you for your patience.  For any questions or concerns, please feel free to contact the GSD Systems Support Group at 303.497.6887 or at address@hidden

On Mon, Sep 22, 2014 at 10:23 PM, Bob Lipschutz - NOAA Affiliate <address@hidden> wrote:

All ESRL/GSD Data Users,

We have made substantial progress toward recovering from our storage system issues. Distribution of HRRR, RAP, FIM and other data sets via ftp and LDM has been available since earlier today.  GSD's THREDDS service is returning now. Other web-based services are largely up, as well.

We still have some residual work to do which may necessitate short service outages in the next day or so, but we don't anticipate any major down time. We will send out additional notices if it seems any outage will be more substantial.

Thank you for your patience.  For any questions or concerns, please feel free to contact the GSD Systems Support Group at 303.497.6887 or at address@hidden

On Mon, Sep 22, 2014 at 8:06 PM, Nicole Saucedo - NOAA Affiliate <address@hidden> wrote:

The troubleshooting continues ...

On Mon, Sep 22, 2014 at 11:32 AM, Systems Support Group <address@hidden> wrote:

The troubleshooting continues ...

On Mon, Sep 22, 2014 at 9:33 AM, Systems Support Group <address@hidden> wrote:

Our sysadmins are working with the DMZ storage engineer on the problem.

GSD web services and data acquisition processes are affected intermittently.

We will keep you informed on the status.

On Fri, Sep 19, 2014 at 1:04 PM, System Support Group <address@hidden> wrote:

All ESRL/GSD Data Users,

We are performing emergency maintenance on our DMZ storage
systems to resolve recent problems.

Delivery of HRRR, RAP, FIM, and RUC model data via ftp and LDM
will be affected until this issue is fixed.  Some GSD web services and
data acquisition processes are affected, as well. Affected systems
include all externally facing VMs supporting NEIS, RTVS, NEVS, and
NextGen.

We will send another notice when systems return to normal operation.

We apologize for the inconvenience. For any questions or concerns,
please feel free to contact SSG at 303.497.6887 or at address@hidden

--

ESRL/GSD/ITS/Systems Support Group 303-497-6887