Skip to content

[v2-11-test] Speed up 2.11 prod image builds with parallel per-python builds#62636

Merged
potiuk merged 1 commit intov2-11-testfrom
speed-up-2-11-prod-image-builds
Feb 28, 2026
Merged

[v2-11-test] Speed up 2.11 prod image builds with parallel per-python builds#62636
potiuk merged 1 commit intov2-11-testfrom
speed-up-2-11-prod-image-builds

Conversation

@potiuk
Copy link
Member

@potiuk potiuk commented Feb 28, 2026

Porting speed up in release image building from main.

Split the release_dockerhub_image workflow to build each Python version as a separate job via a new reusable release_single_dockerhub_image workflow. Images are first pushed by digest, then merged into multi-platform manifests. This also adds an airflow_version_check.py script to auto-detect skip-latest from PyPI, extracts docker utility checks into reusable functions, and adds AMD/ARM runner constants for selective checks.


Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)

Generated-by: Claude Code with Sonet Opus 4.6 following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@boring-cyborg boring-cyborg bot added area:dev-tools backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch labels Feb 28, 2026
@potiuk potiuk force-pushed the speed-up-2-11-prod-image-builds branch 4 times, most recently from 3082159 to 95700ae Compare February 28, 2026 16:51
@potiuk potiuk changed the title Speed up 2.11 prod image builds with parallel per-python builds [v2-11-test] Speed up 2.11 prod image builds with parallel per-python builds Feb 28, 2026
@potiuk potiuk marked this pull request as ready for review February 28, 2026 16:58
@potiuk potiuk force-pushed the speed-up-2-11-prod-image-builds branch from 95700ae to 93886fd Compare February 28, 2026 17:04
Porting speed up in release image building from main.

Split the release_dockerhub_image workflow to build each Python version
as a separate job via a new reusable release_single_dockerhub_image
workflow. Images are first pushed by digest, then merged into
multi-platform manifests. This also adds an airflow_version_check.py
script to auto-detect skip-latest from PyPI, extracts docker utility
checks into reusable functions, and adds AMD/ARM runner constants
for selective checks.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@potiuk potiuk force-pushed the speed-up-2-11-prod-image-builds branch from 93886fd to db092f0 Compare February 28, 2026 17:22
@potiuk potiuk merged commit 7479afe into v2-11-test Feb 28, 2026
68 checks passed
@potiuk potiuk deleted the speed-up-2-11-prod-image-builds branch February 28, 2026 18:51
@potiuk potiuk added the changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..) label Mar 8, 2026
@potiuk potiuk added this to the Airflow 2.11.2 milestone Mar 8, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:dev-tools backport-to-v3-1-test Mark PR with this label to backport to v3-1-test branch changelog:skip Changes that should be skipped from the changelog (CI, tests, etc..)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants