[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

GSD data system down - various data outages



 All data users,

We are experiencing a major problem with one of our
main data ingest systems which caused various data outages.
We are working on the issue and will inform you on the status.

------------------------------------------------
ESRL/GSD/ITS/Systems Support Group

From address@hidden  Mon Aug 13 20:00:28 2012
Return-Path: <address@hidden>
X-Original-To: address@hidden
Delivered-To: address@hidden
Received: by abbott.unidata.ucar.edu (Postfix, from userid 99)
        id 93D3C615B5; Mon, 13 Aug 2012 20:00:28 -0600 (MDT)
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on
        uni18.unidata.ucar.edu
X-Spam-Level: 
X-Spam-Status: No, score=-3.6 required=5.0 tests=AWL,BAYES_00,
        RCVD_IN_DNSWL_MED autolearn=ham version=3.3.1
Received: from mta4.nems.noaa.gov (mta4.nems.noaa.gov [140.90.121.164])
        by abbott.unidata.ucar.edu (Postfix) with ESMTP id D30EC61593;
        Mon, 13 Aug 2012 20:00:27 -0600 (MDT)
Received: from psmtp.com ([74.125.149.177])
 by mta.nems.noaa.gov (Sun Java System Messaging Server 6.2-7.05 (built Sep  5
 2006)) id <address@hidden>
 (original mail from address@hidden); Mon, 13 Aug 2012 22:00:27 -0400 (EDT)
Received: from psmtp.com ([74.125.149.177])
 by mta.nems.noaa.gov (Sun Java System Messaging Server 6.2-7.05 (built Sep  5
 2006)) with ESMTPS id <address@hidden> for
 address@hidden; Mon, 13 Aug 2012 21:59:36 -0400 (EDT)
Received: from na3sys009aog129.obsmtp.com ([74.125.149.142]) (using TLSv1)
 by na3sys009amx196.postini.com ([74.125.148.10]) with SMTP; Tue,
 14 Aug 2012 01:59:36 +0000 (GMT)
Received: from mail-ob0-f197.google.com ([209.85.214.197]) (using TLSv1)
 by na3sys009aob129.postini.com ([74.125.148.12])
 with SMTP      ID DSNKUCmxBz8+6/address@hidden; Mon,
 13 Aug 2012 18:59:36 -0700 (PDT)
Received: by obhx4 with SMTP id x4so12856354obh.0 for
 <address@hidden>; Mon, 13 Aug 2012 18:59:35 -0700 (PDT)
Received: by 10.182.51.65 with SMTP id i1mr15997473obo.45.1344909575251; Mon,
 13 Aug 2012 18:59:35 -0700 (PDT)
Received: by 10.182.51.65 with SMTP id i1mr15997466obo.45.1344909575120; Mon,
 13 Aug 2012 18:59:35 -0700 (PDT)
Received: by 10.182.243.3 with HTTP; Mon, 13 Aug 2012 18:59:14 -0700 (PDT)
Date: Mon, 13 Aug 2012 19:59:14 -0600
From: Systems Support Group <address@hidden>
Subject: Re: GSD data system down - various data outages
In-reply-to:
 <CAPnaLs=K=9nNes4mMDO3OMhVViW=8So9aHNtbSi=Vnma=address@hidden>
To: _OAR ESRL GSD All Data Users <address@hidden>
Cc: Sysadm <address@hidden>,
 GSD Computer Operations <address@hidden>
Message-id: <address@hidden>
MIME-version: 1.0
Content-type: text/plain; charset=ISO-8859-1
Content-transfer-encoding: 7BIT
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com;
 s=20120113;
 h=mime-version:in-reply-to:references:from:date:message-id:subject:to
 :cc:content-type:x-gm-message-state;
 bh=UKsR4Xk2cRRAJU8HA538CuN+XiFPKE+g6EgS7iMiT18=;
 b=Xdl95ucFLxUFq0fjRQmv8xKlGBgZAxFYoJP8YYEqApDWiYrvllkqAuN1k9vhzE4wJA
 br1/JkJgv3SsqXDXYocH1+b/dMXewA1zhRttOesIcd0hxc2goL7oqj1IPOtvZ8DV4KKQ
 mP4Vii5gzfvt2nAofneJKSXHumA59foGTym26IGKdw021lvS05EQ8gr1mVuoC79Da7qg
 s9F+eUYDSVAHtbyC1VB0SnXuTzYKaMQdWpBr/ZIh6uOhHXUK2qudP6mP3P2MsDhjQR8L
 JCtCpuKyCMjaDnBtCpeeZhCtDX3zT8MFOvX+RMgKXMQg70JrFEI1Kh88dYJePEECQe37 rKWg==
X-Gm-Message-State:
 
ALoCoQnlpLhHxVPqD8b6TFf1CG7ljQnTH+LJcZ8LWWjvrumXuoPOy5YSjKhZ2eZ80k3SPsKsN6RC7f91Hz+zIDSNmh73n8F3HK5KyYoRC/LENApkrKYqevF2ilsuD2UXHc+hJ5m+1F7T5nBSuMYAsWeKDo2hBL2OPN0J1tDa/38ZkGQEeLnnxrs=
X-pstn-neptune: 0/0/0.00/0
X-pstn-levels: (S:99.90000/99.90000 CV:99.9000 FC:95.5390 LC:95.5390 R:95.9108
 P:95.9108 M:97.0282 C:98.6951 )
X-pstn-dkim: 0 skipped:not-enabled
X-pstn-settings: 1 (0.1500:0.0015) cv GT3 gt2 gt1
X-pstn-addresses: from <address@hidden> [369/14]
References: <CAPnaLs=K=9nNes4mMDO3OMhVViW=8So9aHNtbSi=Vnma=address@hidden>

The issue has been fixed and all data have been returned.

>  All data users,
>
> We are experiencing a major problem with one of our
> main data ingest systems which caused various data outages.
> We are working on the issue and will inform you on the status.

-------------------------------------------------------
ESRL/GSD/ITS/Systems Support Group