This repository has been archived by the owner on Apr 19, 2024. It is now read-only.

Complete Ingestion of Docker Images #7

Open

10d9e opened this issue Jun 21, 2022 · 1 comment

Assignees

10d9e commented Jun 21, 2022 •

edited

Loading

Create jobs to continually ingest images from target docker registries.
Given the volume of images, the ingestor should have the following:

automatic error recovery/retry logic
persistent repository upload tracker - badgerdb or similar db to track the progress of uploads
explore "batched" upload outside of registry (may not be possible, but worth looking at)

10d9e self-assigned this

10d9e moved this from Backlog to In Progress in IPCR

Author

10d9e commented Jul 25, 2022

This process is quite slow through the native docker client. There may be a better way to rewrite large-scale ingestion

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.