rdrmerge fails when processing multiple merges
Using l0tools-0.2.1-testing.sif
, when calling rdrmerge on multiple instruments, it successfully merges the first (VIIRS) and fails when beginning the second:
input & run location:
[nickb@puff 20221215-173751]$ pwd
/data/users/nickb/j02-merge/noaa20/20221215-173751
[nickb@puff 20221215-173751]$ ls -l
total 1676396
-rw-r--r-- 1 nickb domain users 3367619 Dec 15 19:19 RATMS-RNSCA_j01_d20221215_t1722129_e1735328_b00001_c20221215173510673000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 2715737 Dec 15 19:19 RATMS-RNSCA_j01_d20221215_t1726289_e1737088_b00001_c20221215173655483000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 228532645 Dec 15 19:19 RCRIS-RNSCA_j01_d20221215_t1722129_e1735328_b00001_c20221215173510989000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 183316237 Dec 15 19:19 RCRIS-RNSCA_j01_d20221215_t1726289_e1737088_b00001_c20221215173655731000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 724223605 Dec 15 19:20 RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 574458675 Dec 15 19:20 RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5
rdrmerge output:
[nickb@puff 20221215-173751]$ apptainer exec -B $(pwd):/mnt -H /mnt /data/users/nickb/l0tools/l0tools-0.2.1-testing.sif rdrmerge --verbose *.h5
handling 2 files for j01 RNSCA-RVIRS
extracting RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5
dumping RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5
writing /mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5.science.pkts
...
<snip>
...
merging packet files to /mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5.merge.pds
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5.sci.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5.sc0.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5.sc1.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5.sc2.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5.sci.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5.sc0.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5.sc1.pds>
indexing <PacketStream file=/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5.sc2.pds>
sorting index with 13498 pointers
writing index to <_io.BufferedWriter name='/mnt/tmphlfe8r7h/RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5.merge.pds'>
handling 2 files for j01 RCRIS-RNSCA
Traceback (most recent call last):
File "/usr/local/bin/rdrmerge", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/edosl0util/cli/rdrmerge.py", line 181, in main
for o in merge_rdrs(args.rdr, not_before=args.not_before, workdir=args.workdir):
File "/usr/local/lib/python3.10/dist-packages/edosl0util/cli/rdrmerge.py", line 118, in merge_rdrs
with workdir as tmpdir:
File "/usr/lib/python3.10/contextlib.py", line 133, in __enter__
del self.args, self.kwds, self.func
AttributeError: args
output:
[nickb@puff 20221215-173751]$ ls -l
total 2455320
-rw-r--r-- 1 nickb domain users 3367619 Dec 15 19:19 RATMS-RNSCA_j01_d20221215_t1722129_e1735328_b00001_c20221215173510673000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 2715737 Dec 15 19:19 RATMS-RNSCA_j01_d20221215_t1726289_e1737088_b00001_c20221215173655483000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 228532645 Dec 15 19:19 RCRIS-RNSCA_j01_d20221215_t1722129_e1735328_b00001_c20221215173510989000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 183316237 Dec 15 19:19 RCRIS-RNSCA_j01_d20221215_t1726289_e1737088_b00001_c20221215173655731000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 724223605 Dec 15 19:20 RNSCA-RVIRS_j01_d20221215_t1721472_e1736007_b00001_c20221215173510453000_all-_dev.h5
-rw-r--r-- 1 nickb domain users 797614723 Jan 13 18:48 RNSCA-RVIRS_j01_d20221215_t1721472_e1737261_b00000_c20230113184824843783_ssec_dev.h5
-rw-r--r-- 1 nickb domain users 574458675 Dec 15 19:20 RNSCA-RVIRS_j01_d20221215_t1726033_e1737261_b00001_c20221215173655253000_all-_dev.h5