Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update build workflows to use image caching, multi-arch, auto-tag #925

Merged
merged 69 commits into from
Oct 22, 2023
Merged

Update build workflows to use image caching, multi-arch, auto-tag #925

merged 69 commits into from
Oct 22, 2023

Commits on Oct 19, 2023

  1. refactor: move scripts & josm to contrib dir

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    07d4678 View commit details
    Browse the repository at this point in the history

  2. ci: add contrib label to labeler.yml

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    b263ef4 View commit details
    Browse the repository at this point in the history

  3. ci: separate frontend and backend tests during pr

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    e316941 View commit details
    Browse the repository at this point in the history

  4. ci: remove extract-vars (use auto-tagging)

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    de42945 View commit details
    Browse the repository at this point in the history

  5. build: update dockerfiles and compose to use COMMIT_REFs

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    0fc06ee View commit details
    Browse the repository at this point in the history

  6. ci: build backend images on tag and release events

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    4156fd6 View commit details
    Browse the repository at this point in the history

  7. ci: publish docs on changes to development branch

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    1d9c022 View commit details
    Browse the repository at this point in the history

  8. build: set default S3_ENDPOINT for entrypoint (if not set)

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    962752e View commit details
    Browse the repository at this point in the history

  9. build: add healthchecks to dockerfiles

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    65acea7 View commit details
    Browse the repository at this point in the history

  10. ci: enable backend smoketest using compose --wait

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    d0fb4c6 View commit details
    Browse the repository at this point in the history

  11. build: update odkcentral --> v2023.4.0

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    f95787f View commit details
    Browse the repository at this point in the history

  12. build: healthcheck for minio service

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    8b80645 View commit details
    Browse the repository at this point in the history

  13. ci(pytest): update pytest workflow to use img artifacts

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    ab8ce15 View commit details
    Browse the repository at this point in the history

  14. build: update odkcentral img, add entrypoint + healthcheck

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    37c1796 View commit details
    Browse the repository at this point in the history

  15. ci: fix pytest img tar downloading

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    ae16d40 View commit details
    Browse the repository at this point in the history

  16. ci(pytest): fix cached image loading from /tmp

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    293f2df View commit details
    Browse the repository at this point in the history

  17. ci(pytest): simplify image caching and loading

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    995f7f7 View commit details
    Browse the repository at this point in the history

  18. ci(pytest): remove image cache upload

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    fdacf0a View commit details
    Browse the repository at this point in the history

  19. ci(pytest): add image cache job to end of workflow

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    fd0053f View commit details
    Browse the repository at this point in the history

  20. ci(pytest): set cache loading based on needs outputs

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    349316c View commit details
    Browse the repository at this point in the history

  21. ci(pytest): cache images if download was unsuccessful

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    426a84f View commit details
    Browse the repository at this point in the history

  22. ci(pytest): fix operator !=

    @spwoodcock
    spwoodcock committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    2b59aef View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2023

  1. build: use env vars for all image versions

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    d2c870f View commit details
    Browse the repository at this point in the history

  2. build: ODK_CENTRAL_VERSION --> ODK_CENTRAL_TAG

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    bca417c View commit details
    Browse the repository at this point in the history

  3. ci(pytest): set image tags for caching from github vars

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    6923ca0 View commit details
    Browse the repository at this point in the history

  4. ci: replace deploy workflow with reusable

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    871f07b View commit details
    Browse the repository at this point in the history

  5. ci(pytest): image caching cache_name --> artifact_name

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    884a78f View commit details
    Browse the repository at this point in the history

  6. ci(deploy): set .env from var and secrets context (not manual)

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    e91ea5c View commit details
    Browse the repository at this point in the history

  7. ci(pytest): increase timeout for central wait-for-it 30s

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    6f76e2a View commit details
    Browse the repository at this point in the history

  8. ci(pytest): fix timeout syntax

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    ba1d995 View commit details
    Browse the repository at this point in the history

  9. build: add shebang to odkcentral entrypoint script

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    c83a3b3 View commit details
    Browse the repository at this point in the history

  10. ci: update env to .env for pytest

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    542ff18 View commit details
    Browse the repository at this point in the history

  11. ci(pytest): remove additional -alpine from postgis img

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    6d2802e View commit details
    Browse the repository at this point in the history

  12. build: redact password in odk-central entrypoint

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    cd8da20 View commit details
    Browse the repository at this point in the history

  13. ci: fix to_envs single .env file parsing

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    222aa39 View commit details
    Browse the repository at this point in the history

  14. ci: pass env var directly to jq, not github var

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    d64ba4c View commit details
    Browse the repository at this point in the history

  15. ci(pytest): fix by using scalar over literal syntax

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    2b7c3b9 View commit details
    Browse the repository at this point in the history

  16. build: hardcode WORKER_COUNT=1 for odk-central start

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    79b2d26 View commit details
    Browse the repository at this point in the history

  17. ci: update docs workflow to use new cahcing

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    894cfce View commit details
    Browse the repository at this point in the history

  18. docs: update info for testing workflows via act

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    be175c3 View commit details
    Browse the repository at this point in the history

  19. ci(pytest): add caching img steps directly to workflow (no reuse)

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    70ff49d View commit details
    Browse the repository at this point in the history

  20. ci(pytest): typo image --> images for cache key

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    3b1ae5e View commit details
    Browse the repository at this point in the history

  21. refactor: pydantic deprecation FIeldValidationInfo --> ValidationInfo

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    8e57e49 View commit details
    Browse the repository at this point in the history

  22. ci: rewrite pytest to build pr image prior to test

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    2c0b2db View commit details
    Browse the repository at this point in the history

  23. ci: don't push,cache,multi_arch PR image builds

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    83b5c2c View commit details
    Browse the repository at this point in the history

  24. ci: add permissions: write to pytest build + scan=false

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    d1aa451 View commit details
    Browse the repository at this point in the history

  25. ci: remove permissions from pytest (handle downstream)

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    78f054a View commit details
    Browse the repository at this point in the history

  26. ci: update conditionals for building pr images

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    663ad01 View commit details
    Browse the repository at this point in the history

  27. ci: update pytest cache-hit output

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    cfe9c1f View commit details
    Browse the repository at this point in the history

  28. ci: get image_tag instead of image_name from output

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    14ea453 View commit details
    Browse the repository at this point in the history

  29. ci(pytest): fix case where cache hit, skip build

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    149c154 View commit details
    Browse the repository at this point in the history

  30. ci(pytest): set BACKEND_IMG_TAG in all if cases

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    2b3c540 View commit details
    Browse the repository at this point in the history

  31. ci(pytest): replace BACKEND_IMG_TAG --> API_TAG_OVERRIDE

    @spwoodcock
    spwoodcock committed Oct 20, 2023
    Configuration menu
    Copy the full SHA
    5779aa6 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2023

  1. ci(pytest): fix getting backend image tag from docker img ls

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    8c0118c View commit details
    Browse the repository at this point in the history

  2. ci(pytest): only run image caching steps if explicity cache=false

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    f18ad1a View commit details
    Browse the repository at this point in the history

  3. ci(pytest): revert ==false to !=true negation

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    9f8f8b9 View commit details
    Browse the repository at this point in the history

  4. ci: replace all refs to repo with gh vars

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    33123ee View commit details
    Browse the repository at this point in the history

  5. ci(pytest): prep pytest for moving to gh-workflows

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    406dd72 View commit details
    Browse the repository at this point in the history

  6. ci(pytest): test with caching off

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    3ec3c0d View commit details
    Browse the repository at this point in the history

  7. ci(pytest): remove redundant var build_test_img

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    814b5e0 View commit details
    Browse the repository at this point in the history

  8. ci(pytest): fix "" workflow syntax --> ''

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    afc3188 View commit details
    Browse the repository at this point in the history

  9. ci(pytest): quote ci-development fallback

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    0b5c008 View commit details
    Browse the repository at this point in the history

  10. ci(pytest): move where default ci-development tag is set

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    4aa8451 View commit details
    Browse the repository at this point in the history

  11. ci(pytest): reenable caching for workflow images

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    9ec6cee View commit details
    Browse the repository at this point in the history

  12. ci(pytest): inputs.cache_imgs to array

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    99dd6cb View commit details
    Browse the repository at this point in the history

  13. ci(pytest): allow passing of image_tag to image build stage

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    9cc4c79 View commit details
    Browse the repository at this point in the history

  14. ci: replace all reusable workflows with hotosm/gh-workflows

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    35cdf24 View commit details
    Browse the repository at this point in the history

  15. ci(pytest): use new format of reusable pytest workflow

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    f8cd157 View commit details
    Browse the repository at this point in the history

  16. build: rename API_TAG_OVERRIDE --> TAG_OVERRIDE

    @spwoodcock
    spwoodcock committed Oct 22, 2023
    Configuration menu
    Copy the full SHA
    d82cb13 View commit details
    Browse the repository at this point in the history