AIP-88: Lazy expandable task mapping#51391

Draft

dabla wants to merge 431 commits intoapache:mainfrom

dabla:feature/aip-88-lazy-expandable-tasks

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 12, 2025

Add revoke_task implementation to EdgeExecutor for task queued timeout support (#56240)

authored and
dabla
committed
Fix SQLA Mapped datetime imports in models (#56264)

amoghrajesh
authored and
dabla
committed
Remove timeout parameter from the dataproc_metastore sys test (#56247)

VladaZakharova
authored and
dabla
committed
Fix wrong import of `AIRFLOW_V_3_0_PLUS` in `AwsLambdaExecutor` (#56280)

o-nikolas
authored and
dabla
committed
Add async support for Amazon SQS Notifier (#56159)

ferruzzi
authored and
dabla
committed
Prepare fab and amazon providers to release (September 2025) (#56241)

eladkal
authored and
dabla
committed
UI: Add Expand/Collapse all to XComs page (#56083)

KatalKavya96
authored and
dabla
committed
Only import OpenLineage plugin listeners/hooks if plugin is enabled (#56266)

jedcunningham
authored and
dabla
committed
Fix ValueError in def operators in google provider (#55821)

VladaZakharova
authored and
dabla
committed
Refactor: deprecate wait_policy in EmrCreateJobFlowOperator in favor of wait_for_completion (#56158)

laksh-krishna-sharma
authored and
dabla
committed
UI: Fix Grid for cleared runs when tasks were removed (#56085)

ephraimbuddy
authored and
dabla
committed
Revert "Update all models to use `sqlalchemy` 2 annotations (#55954)" (#56296)

vincbeck
authored and
dabla
committed
Fix multi-line drag selection in task log view (#56238)

authored and
dabla
committed
fix(i18n): Add translation keys and remove fallback (#56274)

RoyLee1224
authored and
dabla
committed
Add a prototype Edge Worker client to the Go SDK (#56290)

ashb
authored and
dabla
committed
Enable PT011 rule to prvoider tests (#56277)

xchwan
authored and
dabla
committed
Default checkPendingRuns to false (#56307)

bbovenzi
authored and
dabla
committed
[AWS System Tests] Add task retries to deletion of EKS resources (#56308)

ramitkataria
authored and
dabla
committed
Fix FAB provider name in auth manager section of release notes (#56301)

jedcunningham
authored and
dabla
committed
nit: Bump required OL client for Openlineage provider (#56302)

kacpermuda
authored and
dabla
committed
Fix config section in warning about db scheme (#56316)

jedcunningham
authored and
dabla
committed
Enable PT011 rule to prvoider tests (#56320)

xchwan
authored and
dabla
committed
Use TI duration from db instead of UI calculated (#56310)

bbovenzi
authored and
dabla
committed
Avoid using rem for icons for safari compatibility (#56304)

bbovenzi
authored and
dabla
committed
Update recent runs bar chart and improve responsiveness (#56314)

bbovenzi
authored and
dabla
committed
attempt to update 3.0.1 release notes for serialization interface change (#56318)

sjyangkevin
authored and
dabla
committed
Expand and collapse group component (#56293)

pierrejeambrun
authored and
dabla
committed
Enable PT011 rule to prvoider tests (#56237)

xchwan
authored and
dabla
committed
Add if_not_exists to index creation in migrations (#56328)

meher1993
authored and
dabla
committed
Fix dataflow java system test + link (#56286)

VladaZakharova
authored and
dabla
committed
Bump ruff to 0.13.3 and prek to 0.2.3 (#56355)

amoghrajesh
authored and
dabla
committed
fix: allow mapped tasks to accept zero-length inputs on rerun (#56162)

kevinhongzl
authored and
dabla
committed
Chart gitsync vars (#56245)

ido177
authored and
dabla
committed
Update provider's metadata (#56357)

potiuk
authored and
dabla
committed
Fix install_java.sh (#56211)

authored and
dabla
committed
Add new PL translations. (#56359)

potiuk
authored and
dabla
committed
feature: Add OpenLineage support for CloudDataTransferServiceS3ToGCSOperator (#55946)

pawelgrochowicz
authored and
dabla
committed
feature: Add OpenLineage support for SpannerQueryDatabaseInstanceOperator (#56348)

pawelgrochowicz
authored and
dabla
committed
Add a section in contributors guide about working with dags (#56362)

amoghrajesh
authored and
dabla
committed
Update _helpers.yaml to support custom apiServerConfigConfigMapName (#52634)

authored and
dabla
committed
fix(livy): replace connection type (#55984)

authored and
dabla
committed
Reapply "update AzureBaseHook to return credentials that supports get_token method" (#56228)

authored and
dabla
committed
Restrict universal-pathlib 0.3.0 (#56370)

gopidesupavan
authored and
dabla
committed
Prefer BigQueryInsertJobOperator's project_id over hook's project_id for openlineage (#55948)

BasPH
authored and
dabla
committed
fix: modify min width for task names (#56378)

RoyLee1224
authored and
dabla
committed
Prepare fab provider rc2 to release (October 2025) (#56384)

eladkal
authored and
dabla
committed
Fix providers release manager docs (#56385)

eladkal
authored and
dabla
committed
update breeze Option B quick setup (#56333)

andwct
authored and
dabla
committed
Add msgraphfs provider (#55454)

bolkedebruin
authored and
dabla
committed
include task instance id in log printed by supervisor (#56383)

rawwar
authored and
dabla
committed
replace start-airflow with stop_airflow (#56390)

anujarora0502
authored and
dabla
committed
Make Dag Run ID visible in Dag Header Card (#56392)

jscheffl
authored and
dabla
committed
Use Task Display Name in Grid if existing (#56393)

jscheffl
authored and
dabla
committed
fix: show appropriate time units in grid view (#56403)

RoyLee1224
authored and
dabla
committed
Build correct SQLAlchemy URI in TeradataHook (#56305)

sc250072
authored and
dabla
committed
Close German translation gaps for full UI translation 2025-10-05 (#56415)

jscheffl
authored and
dabla
committed
Limit astroid to < 4 to fix broken docs builds (#56419)

amoghrajesh
authored and
dabla
committed
Werkzeug Version Check (#56398)

utieyin
authored and
dabla
committed
AIP-82: implement Google Pub/Sub message queue provider (#54494)

dejii
authored and
dabla
committed
Revert "AIP-82: implement Google Pub/Sub message queue provider (#54494)" (#56423)

jason810496
authored and
dabla
committed
Fix scheduler crash with email notifications (#56429)

kaxil
authored and
dabla
committed
Add uvicorn to spelling ignore list (#56441)

kaxil
authored and
dabla
committed
Bump uv version to 0.8.24 and prek to 0.2.4 (#56464)

amoghrajesh
authored and
dabla
committed
Bump uv version to 0.9.0 and ruff to 0.14.0 (#56467)

amoghrajesh
authored and
dabla
committed
Fix Edge3 provider navigation with webserver base_url configuration (#56189)

authored and
dabla
committed
Emit log stream stopped warning as ndjson (#56474)

ianbuss
authored and
dabla
committed
feat: make clipboard hover (#56382)

RoyLee1224
authored and
dabla
committed
Allow sub-pages in React UI plugins (#56413)

jscheffl
authored and
dabla
committed
56058: Validating latestRun before accessing its properties (#56303)

authored and
dabla
committed
Fix broken main after pydantic 2.12.0 (#56483)

jscheffl
authored and
dabla
committed
Simple sending of return value to XCom (#56481)

ashb
authored and
dabla
committed
feature: Add Open Lineage support for CloudDataFusionStartPipelineOperator (#56365)

pawelgrochowicz
authored and
dabla
committed
Add use_rest_api parameter for CloudComposerDAGRunSensor for pulling dag_runs using the Airflow REST API (#56138)

MaksYermak
authored and
dabla
committed
Added Vrahad Analaytics to the list of companies using Apache Airflow (#56472)

varun-bhardwaj-sde
authored and
dabla
committed
Bump python 3.9 to 3.9.23 and 3.12 to 3.12.12 (#56505)

amoghrajesh
authored and
dabla
committed
Add is_favorite to ui dags list (#56341)

bbovenzi
authored and
dabla
committed
Use Task Display Name in Graph if existing (#56455)

jscheffl
authored and
dabla
committed
Add MSCI to company list (#56518)

macdub
authored and
dabla
committed
adding Boeing to inthewild.md (#56515)

twk123
authored and
dabla
committed
fixed the bug report template dropdown option list (#56519)

authored and
dabla
committed
docs: adding usafacts to in the wild doc (#56520)

jakepage11
authored and
dabla
committed
Bump uv version from 0.9.0 to 0.9.1 (#56512)

bugraoz93
authored and
dabla
committed
Fix use of DeprecationWarning in celeray provider to AirflowProviderDeprecationWarning (#56526)

authored and
dabla
committed
Add rancher-desktop to PREFERRED_CONTEXTS in docker_command_utils (#56525)

sage-ingle-ck
authored and
dabla
committed
Removing `amoghrajesh` from older org (#56524)

amoghrajesh
authored and
dabla
committed
Update Snowflake docs with breaking change (#56516)

awiede
authored and
dabla
committed
Fixed typos in governance and rules file (#56521)

rj-pawar
authored and
dabla
committed
Add Intuit as a company using Airflow (#56517)

nguy4130
authored and
dabla
committed
Fix openlineage dag state event emit on timed out dag (#56542)

antonlin1
authored and
dabla
committed
add `Datadog` as company using airflow (#56546)

authored and
dabla
committed
fix a typo in INTHEWILD.md file (#56547)

hussein-awala
authored and
dabla
committed
refactor: Removed changes related to lazy task expansion
dabla
committed
Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Oct 13, 2025

refactor: Fixed ident in _get_ready_tis of DagRun model
dabla
committed

Commits on Nov 4, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Nov 6, 2025

Commits on Nov 7, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Nov 12, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Nov 13, 2025

Commits on Nov 14, 2025

Commits on Nov 26, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Dec 4, 2025

Commits on Dec 6, 2025

Commits on Dec 8, 2025

Commits on Dec 9, 2025

Commits on Dec 11, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Dec 12, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Dec 15, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Dec 17, 2025

Commits on Dec 19, 2025

Commits on Dec 21, 2025

Commits on Dec 25, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Dec 26, 2025

Commits on Dec 27, 2025

Commits on Dec 28, 2025

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored

Commits on Dec 29, 2025

refactor: Fixed base handle_event_submit method by allowing additional parameters to be passed
dabla
committed

Commits on Dec 31, 2025

Commits on Jan 5, 2026

Commits on Jan 6, 2026

Commits on Jan 7, 2026

Commits on Jan 9, 2026

Commits on Jan 15, 2026

Merge branch 'main' into feature/aip-88-lazy-expandable-tasks
dabla
authored