Default to pqinsert -i
For deduplication purposes, pqinsert -i
is preferred when working with GRB products, since equivalent files are produced that are non-identical. JerryR noted that Unidata is using "pqinsert -i" to make the MD5 signature based on product name and not content. Ref https://www.unidata.ucar.edu/software/ldm/man/pqinsert
-
Add PQINSERT_FLAGS which defaults to -i
to nc_fits_pqinsert.sh -
Add same to hcast2scmi.sh -
test on VM ingestors to ensure no impact -
confirm that deduplication happens when multiple GRB systems feed data to a single downstream LDM
Edited by Ray Garcia