Skip to content

Update to use YAML product config and remove shapefile functionality

David Hoese requested to merge feature-geosphere-yaml into master

Similar to other components in the processing chain, I want product information to come from a single location. In that effort this MR adds a copy of the GeoSphere API YAML configuration file to use it for initializing the database and finding other information about the products being processed. To fully take advantage of this file tile-gen will need more information from Geo2Grid (see geosphere-geo2grid#2 (closed)).

This MR also removes all logic related to shapefiles. The shapefiles, as a format, required a bad design revolving around having a list of all of the current indexed files. Each part of this process of removing or adding images from the database should be a separate process. I think this will really simplify the logic and speed up each individual process. This should also make S3 support much easier from a performance point of view as we won't need to glob for every possible file on S3 during the "add" step.

Merge request reports