Skip to content

Dropped 825 when merging VIIRS with 0.17.0

From Steve (https://ssec-sips.slack.com/archives/D02SW7WRM/p1676589866185209)

so I ran these commands:

edosl0trunc  ~/code/edosl0util/tests/fixtures/P1570826VIIRSSCIENCE6T17270135400001.PDS  -o out1.PDS "2017-09-27 13:54:00" "2017-09-27 13:55:00"
edosl0trunc ~/code/edosl0util/tests/fixtures/P1570826VIIRSSCIENCE6T17270135400001.PDS  -o out2.PDS "2017-09-27 13:55:00" "2017-09-27 13:56:00"

then run merge:

cd ~/code/edosl0util/
git checkout 82a1f0c
edosl0merge out1.PDS out2.PDS -o bad.pds
git checkout 101ab5c
edosl0merge out1.PDS out2.PDS -o good.pds

Then in python i did:

from edosl0util import stream
bad = list(stream.jpss_packet_stream(open('bad.pds','rb')))
good = list(stream.jpss_packet_stream(open('good.pds','rb')))
for i in range(len(good)):
    if good[i].bytes() != bad[i].bytes():
         break

which shows:

In [6]: i
Out[6]: 8271

In [7]: good[i-1:i+2]
Out[7]: 
[<Packet apid=821 seqid=1041 stamp=None size=2794 offset=21503270>,
 <Packet apid=825 seqid=8193 stamp=2017-09-27 13:54:59.275810 size=168 offset=21506064>,
 <Packet apid=825 seqid=8194 stamp=None size=3510 offset=21506232>]

In [8]: bad[i-1:i+2]
Out[8]: 
[<Packet apid=821 seqid=1041 stamp=None size=2794 offset=21503270>,
 <Packet apid=826 seqid=1025 stamp=2017-09-27 13:54:59.275810 size=9318 offset=21506064>,
 <Packet apid=806 seqid=1042 stamp=2017-09-27 13:55:01.055065 size=180 offset=21515382>]

so the bad file dropped an 825 packet