Incomplete message can cause exception in key extraction
@rickk notes that he's seen this exception in multi-server amqpfind messages. It's plausible that this is causing an exception-driven memory leak.
ERROR:__main__:could not evaluate key for {'__topic__': 'geo.goes.g17.abi.adde.realtime.area.product.complete', '__reception_time__': '2020-11-23T17:18:16.333065', '__reception_host__': 'mq1.ssec.wisc.edu', 'medium': 'adde', 'start_time': '2020-11-23 17:17:55.5', 'end_time': '2020-11-23 17:18:01.8', 'DQF_percent_good_pixel': '0.9925040', 'coverage': 'Mesoscale-2', 'create_time': '2020-11-23 17:18:08.2', 'band': 9, 'title': 'ABI Stretched RGB', 'message_type': 'product', 'data_type': 'RadM2', 'server_type': 'realtime', 'DQF_percent_focal_plane_temperature_threshold_exceeded': '0.0000000', 'satellite_location': 'GOES-West', 'satellite_family': 'GOES', 'status': 'complete', 'adde_dataset': 'G17RGBST/M2-READY', 'quality_score': '1.0000000', 'signal_type': 'grb', 'percent_score': '0.9925040', 'mode': '6', 'server_ip': 'satbuf1.ssec.wisc.edu', 'satellite_ID': 'G17', 'instrument': 'ABI'}: Traceback (most recent call last):
File "/home/oper/bin/amqpfind/amqpfind.py", line 427, in key_for_msg
return eval(self.key_code, self.namespace(), dict(msg)) if self.key_code else None
File "<string>", line 1, in <module>
NameError: name 'path' is not defined
-
revise key_for_msg to not generate exceptions (but still generate errors) on nonconforming input -
check for other input-fragility cases and follow up with other tickets