Skip to content

Refactor and fix problems in gpkg-to-pgdump.yml #36

@anthonyfok

Description

@anthonyfok

The current .github/workflows/gpkg-to-pgdump.yml has several issues to be resolved.

  1. The steps for "opendrr-boundaries.dump-generation from GeoPackage files" take quite a long time (about 40 minutes) and not strictly necessary because it is essentially identical to opendrr-boundaries.sql that Will uploads routinely anyway. Let's move these steps to a separate workflow file.

  2. Revert gpkg-to-pgdump: Disable keep-cache-fresh cron schedule #29 and restore Git LFS cache refresher workflow in a separate "cache-refresher.yml" file, so in case it gets deactivated by GitHub for inactivity over 60 days, the normal workflows won't be deactivated too.

  3. Use concurrency to run a single job at a time. There was problem with multiple runs uploading to B2 or S3 at the same time resulting in failure. See:

  4. Rethink whether to trigger the workflow(s) for pushes to master, and whether to do something for pull requests.

  5. Add manual workflow_dispatch trigger to allow uploading of release asset files to existing release. Thanks to @DamonU2 for pioneering this feature in Action fix earthquake-scenarios#19

    • See if the release version can be specified manually as tag_name with softprops/action-gh-release@v1
  6. See also Split opendrr-boundaries.{sql,dump} into 2GB chunks before uploading as release assets #34, to be dealt with probably in the same pull request.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions