Skip to content
Snippets Groups Projects
Select Git revision
  • c24f97725c84f0c559c19cccd61081f08db99413
  • master default protected
  • 13-curl
  • temporal-cleaning
  • 16-bracketed-forecasts
  • test-examples
  • progress-api
  • example
  • sphinx
  • newlock
10 results

csppfetch

Alan De Smet's avatar
Never catch all exceptions
Alan De Smet authored 
It was eaching KeyboardInterrupt and causing me grief.
(A small exception is granted for a case that does cleanup and re-raises
te exception.)
c24f9772
History
Alan De Smet's avatar c24f9772
History
Name Last commit Last update
csppfetch
docs
example
.gitignore
Makefile
README.rst
README.rst

csppfetch

csppfetch is a Python 3 module for downloading dynamic ancillary data. It can:

  • Maintain a local cache of ancillary data
  • Download the specific ancillary data files needed to process a given time step
    • Using the local cache if available
    • Optionally updating the local cache

Final files in the cache are atomically created; from the perspective of other programs a given ancillary data file either completely exists or doesn't exist at all.

Multiple copies of this module can safely run at the same time; locks are used to ensure they don't interfere with each other. (Your operating system and filesystem will need to correctly implement lockf.)

If a file is already present in the local cache, this module will NOT replace them; their existence is assumed to mean they are correct. To force a re-download, delete the existing file.

csppfetch implements the CSPP Geo ancillary download behavior guidelines.

Requires Python 3.6 or later.