[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

global AVHRR visible channel CDR product



Hi,

 

I am just resending a copy of an email I wrote a month or so ago regarding easier access to large data downloads for the PATMOS dataset.  I would be grateful if you could give me some guidance on the matters raised please?

 

Kind regards,

 

Tim Smyth

 

From: Tim Smyth
Sent: 28 February 2013 11:29
To: address@hidden
Subject: global AVHRR visible channel CDR product

 

Dear Sir / Madam,

 

I am currently investigating the possibilities of using the AVHRR visible channel record to put together a proposal for investigating how a species of highly reflective marine phytoplankton have shifted in their global distribution over the past 30 years.  Mike Foster and Andrew Heidinger kindly pointed me towards the AVHRR Pathfinder Atmospheres- Extended (PATMOS-x) Reflectance data set available from the catalog:

 

http://data.ncdc.noaa.gov/thredds/patmosxCatalog.html

 

Dr John Caron suggested that I contacted NCDC directly.  It seems with some testing and code writing on my part, that the dataset is ideal (I require Channel 1 and 2 reflectances as well as the attendant geometries to do other corrections).

 

However, each daily global file at 0.1 degree resolution (which is required to look at the features of interest) and the parameters required results in a netCDF file of approximately 155 Mb.  Each of these takes about a minute to put together the request on the website and then a further 8 minutes to download.

 

Putting all of these numbers together, for the 35 year time series, results in:

 

2 Tb of data to download

90 days of download time(!)

 

I was wondering whether or not there are some alternative options that we could investigate to:

(1)    Speed up the data subsetting and;

(2)    Transfer the data across.

 

Please?  One option we have looked at in the past is sending discs over to agencies so that the data can be physically couriered across.

 

I would be very grateful if you could help me in this matter please?

 

Yours sincerely,

 

Tim Smyth

 

Dr Tim Smyth
Acting Head of Science: Cycling in the Sunlit Ocean

Plymouth Marine Laboratory
Prospect Place
Plymouth
Devon
PL1 3DH, UK

Tel: +44 1752 633466
Fax: +44 1752 633101

 

Latest news: www.pml.ac.uk and @PlymouthMarine

Plymouth Marine Laboratory (PML) is a company limited by guarantee registered in England & Wales, company number 4178503. Registered Charity No. 1091222. Registered Office: Prospect Place, The Hoe, Plymouth  PL1 3DH, UK. 

This message is private and confidential. If you have received this message in error, please notify the sender and remove it from your system. You are reminded that e-mail communications are not secure and may contain viruses; PML accepts no liability for any loss or damage which may be caused by viruses.