[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #HPT-985091]: NEXRAD2 concatenating with l2assemble.py

Ziv,

I'm guessing you ran something like shasum to compare the files? Here's what 
happens if I do that (first file is yours, second AWS):

>shasum KLGX*.gz
af242d3ba7e19cdb69f4d560042754fa5e282159  KLGX20160222_215917_V06.gz
fdc33e7fa94bddbf70056e3cb280f7103e2d8c85  KLGX20160222_215917_V06 (1).gz

So no, they don't match. This is because gzip contains the file modification 
time for the file being compressed: http://www.zlib.org/rfc-gzip.html

But if I uncompress the files:

>shasum KLGX*
9eda3173f0ab20de0195a5cb3d27f47745de1479  KLGX20160222_215917_V06
9eda3173f0ab20de0195a5cb3d27f47745de1479  KLGX20160222_215917_V06 (1)

They match completely. So if you want to verify your collection against AWS, 
you'll need to make sure you compare the uncompressed files--there's no 
possible way your gzip files will be bit-for-bit matches (due to gzip's 
timestamps)

Ryan

> Shoot, the last URL is wrong... here is the corrected version
> http://home.uchicago.edu/~ziv/KLGX20160222_215917_V06.gz
> 
> 
> On Tue, Mar 1, 2016 at 4:45 PM, Ziv Dreyfuss <address@hidden> wrote:
> 
> > Hi Ryan,
> >
> > Here are links to download 3 files that do not match their Amazon
> > counterparts.
> >
> > http://home.uchicago.edu/~ziv/KAKQ20160222_215645_V06.gz
> >
> > http://home.uchicago.edu/~ziv/KBMX20160222_215813_V06.gz
> > <http://home.uchicago.edu/~ziv/KAKQ20160222_215645_V06.gz>
> >
> > http://home.uchicago.edu/~zivKLGX20160222_215917_V06.gz
> >
> > Thanks!
> >
> > Best,
> >
> > Ziv
> >
> >
> >
> >
> > address@hidden> wrote:
> >
> >> Ziv,
> >>
> >> The attachment didn't make it through. Can you post it somewhere and I'll
> >> download it?
> >>
> >> Ryan
> >>
> >> > Let me know if you can discern any discrepancy between the files being
> >> > produced through my feed and the Amazon files.


Ticket Details
===================
Ticket ID: HPT-985091
Department: Support IDD
Priority: Normal
Status: Open