- Sep 03, 2021
-
-
Alan De Smet authored
This matches the old aitf-mirror behavior (and matching tests)
-
Alan De Smet authored
-
Alan De Smet authored
Relative to the dst passed to Downloader's update_cache/download_for_time
-
Alan De Smet authored
-
Alan De Smet authored
It was an overly clever hack. Manage summaries directly
-
Alan De Smet authored
Previously we relied on DownloadStats.report() to do it, but we don't guarantee that will happen anymore. And really, when Downloader.update_cache or Downloader.download_for_time finish, it's done and should be marked as such.
-
Alan De Smet authored
It's no longer needed and it was an over-clever hack. #6
-
Alan De Smet authored
instead of magical logging.progress level. #6
-
- Sep 02, 2021
-
-
Alan De Smet authored
-
Alan De Smet authored
DownloadStatistics.all_files() returns files that were downloaded or found in the cache Part of #5
-
Alan De Smet authored
-
Alan De Smet authored
Part of #5
-
Alan De Smet authored
To do this, DownloadStatistics is now mandatory and tracks files found.
-
-
Alan De Smet authored
This fixes the OTHER problem: the test files to download were too small and could be plausibly retrieved within 1 second, so tests inside the SSEC could fail to trigger the timeout.
-
Alan De Smet authored
Individual downloads need individual destinations. I don't know why it was working before. I'm not sure why it wasn't working now. It's still broken, but for a different reason! :-)
-
Alan De Smet authored
-
Alan De Smet authored
Eliminates the need for the scripts change their own sys.path. Also gets the non-stock dateutil.parser
-
Alan De Smet authored
Slightly simplifies the import and testing.
-
Alan De Smet authored
Either should work, but the needed files disappeared from geodb.
-
Alan De Smet authored
-
- Sep 01, 2021
-
-
Alan De Smet authored
If all of the filesets are NOT expected, it's okay, just log at INFO. If any fileset IS expected, that's worrying and generates a WARNING. ERROR is too severe because we might be able to continue, and there is a good chance that the error is entirely remote.
-
Alan De Smet authored
3 hour delays are typical. 4.5 hours delays are moderately common.
-
Alan De Smet authored
Matches original aitf-mirror behavior in cache update mode.
-
- Aug 30, 2021
-
-
Alan De Smet authored
It's purely speculative work: "Guess what people might find useful."
-
Alan De Smet authored
-
Alan De Smet authored
If we're --cache-only, we DEFINITELY need to use the user provided cache directory, even if not writable.
-
- Aug 25, 2021
-
-
Alan De Smet authored
-
Alan De Smet authored
-
- Aug 20, 2021
-
-
Alan De Smet authored
-
Alan De Smet authored
-
Alan De Smet authored
-
Alan De Smet authored
-
Alan De Smet authored
Remove timestamp if period >= 1 day
-
Alan De Smet authored
We no longer emit the timestamp when self.period >= 1 day
-
Alan De Smet authored
Should be: 2020-01-01 12:00:00 Was incorrect: 2020-01-0112:00:00
-
Alan De Smet authored
aitf-data-for-run now uses "--cache PATH" while aitf-update-cache continues to use a bare "PATH"
-
Alan De Smet authored
aitf relies on the behavior
-
Alan De Smet authored
-
Alan De Smet authored
Useful for GFS, which can fallback to a day earlier, but needs the 12+ hour forecasts, which we normally wouldn't get.
-