Automated ingestion to Staging and Production Catalogs

[smohiudd]

Description

Based on previous work and discussion around the dataset publication and promotion process, this was the agreed workflow:

A dataset config PR would kick off a staging ingest; approval of the PR would automate the ingestion to the production catalog.

There is an existing PR that implements most of this process however it also includes creating a PR in veda-config. To create a more modular data promotion process, we need to break apart the ingestion automation the veda-config PR creation. This ticket involves only automating ingestion into the staging and production catalogs and not around creating PRs in veda-config.

Acceptance Criteria

• Include Github workflow action that publishes to Staging and Production catalogs