Skip to content

Commit

Permalink
Update existing significant newsfragments with the later introduced t…
Browse files Browse the repository at this point in the history
…emplate format (apache#45678)

* docs(newsfragments): add empty entities to significant newsfragments

* docs(newsfragments): update existing siginificant newsfragments with template format

* docs(newsfragments): fix typo in 41391, 41533

* docs(newsfragments): add type "Code interface change"

* docs(newsfragments): aip-79: make it dependency change

* docs(newsfragmenst): update 42042 change type

Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>

* docs(newsfragmenst): update 40029 change type

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>

* docs(newsfragmenst): update 41758 change type

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>

* docs(newsfragmenst): update 43612 change type

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>

* docs(newsfragmenst): update 41808 change type

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>

* docs(newsfragmenst): update 41774 change type

Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>

* docs(newsfragments): add description to each of the change type

* docs(newsfragments): fix plural typo

* docs(newsfragments): replace DAG as Dag

* style(newsfragments): add type of change to significant

* docs(newsfragments): fix type of changes typo

* docs(newsfragments): unify ruff rules format

---------

Co-authored-by: Vincent <97131062+vincbeck@users.noreply.github.com>
Co-authored-by: Jens Scheffler <95105677+jscheffl@users.noreply.github.com>
  • Loading branch information
3 people authored Jan 24, 2025
1 parent 51dbabc commit d460972
Showing 115 changed files with 2,094 additions and 266 deletions.
1 change: 1 addition & 0 deletions .github/workflows/news-fragment.yml
Original file line number Diff line number Diff line change
@@ -68,6 +68,7 @@ jobs:
'Behaviour changes'
'Plugin changes'
'Dependency changes'
'Code interface changes'
)
news_fragment_content=`git diff origin/${BASE_REF} newsfragments/*.significant.rst`
11 changes: 11 additions & 0 deletions newsfragments/24842.significant.rst
Original file line number Diff line number Diff line change
@@ -4,3 +4,14 @@ When a *schedule* parameter is not passed to the ``DAG`` constructor, Airflow
now defaults to never automatically schedule the DAG at all. The created DAG
can still be manually triggered, either by the user directly, or from another
DAG with ``TriggerDagRunOperator``.

* Types of change

* [ ] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [x] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
19 changes: 18 additions & 1 deletion newsfragments/40029.significant.rst
Original file line number Diff line number Diff line change
@@ -1 +1,18 @@
Removed deprecated ``allow_raw_html_descriptions`` option from UI Trigger forms.
Removed deprecated airflow configuration ``webserver.allow_raw_html_descriptions`` from UI Trigger forms.

* Types of change

* [ ] Dag changes
* [x] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ``airflow config lint``

* [x] ``webserver.allow_raw_html_descriptions``
11 changes: 11 additions & 0 deletions newsfragments/40931.significant.rst
Original file line number Diff line number Diff line change
@@ -1 +1,12 @@
Removed dagbag deprecated ``store_serialized_dags`` parameter. Please use ``read_dags_from_db`` parameter.

* Types of change

* [ ] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
17 changes: 17 additions & 0 deletions newsfragments/41096.significant.rst
Original file line number Diff line number Diff line change
@@ -1 +1,18 @@
Removed deprecated ``processor_poll_interval`` configuration parameter from ``scheduler`` section. Please use ``scheduler_idle_sleep_time`` configuration parameter.

* Types of change

* [ ] Dag changes
* [x] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ``airflow config lint``

* [x] ``scheduler.processor_poll_interval`` → ``scheduler.scheduler_idle_sleep_time``
388 changes: 236 additions & 152 deletions newsfragments/41348.significant.rst

Large diffs are not rendered by default.

19 changes: 19 additions & 0 deletions newsfragments/41366.significant.rst
Original file line number Diff line number Diff line change
@@ -1,3 +1,22 @@
``airflow.contrib`` modules have been removed

All modules from ``airflow.contrib``, which were deprecated in Airflow 2, have been removed.

* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] ``airflow.contrib.*``
11 changes: 11 additions & 0 deletions newsfragments/41367.significant.rst
Original file line number Diff line number Diff line change
@@ -2,3 +2,14 @@ Deprecated ``ImportError`` removed from ``airflow.models``

The deprecated ``ImportError`` class can no longer be imported from ``airflow.models``.
It has been moved to ``airflow.models.errors.ParseImportError``.

* Types of change

* [ ] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
159 changes: 159 additions & 0 deletions newsfragments/41368.significant.rst

Large diffs are not rendered by default.

21 changes: 19 additions & 2 deletions newsfragments/41390.significant.rst
Original file line number Diff line number Diff line change
@@ -1,7 +1,5 @@
Support for SubDags is removed

**Breaking Change**

Subdags have been removed from the following locations:

- CLI
@@ -12,3 +10,22 @@ This removal marks the end of Subdag support across all interfaces. Users
should transition to using TaskGroups as a more efficient and maintainable
alternative. Please ensure your DAGs are updated to
remove any usage of Subdags to maintain compatibility with future Airflow releases.

* Types of change

* [x] Dag changes
* [ ] Config changes
* [x] API changes
* [x] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] ``airflow.operators.subdag.*``
22 changes: 20 additions & 2 deletions newsfragments/41391.significant.rst
Original file line number Diff line number Diff line change
@@ -1,5 +1,23 @@
**Breaking Change**

The ``airflow.providers.standard.sensors.external_task.ExternalTaskSensorLink`` class has been removed.

This class was deprecated and is no longer available. Users should now use
the ``airflow.providers.standard.sensors.external_task.ExternalDagLink`` class directly.

* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] ``airflow.sensors.external_task.ExternalTaskSensorLink`` → ``airflow.sensors.external_task.ExternalDagLink``
24 changes: 20 additions & 4 deletions newsfragments/41393.significant.rst
Original file line number Diff line number Diff line change
@@ -1,7 +1,4 @@
**Breaking Change**

The ``use_task_execution_day`` parameter has been removed from the ``DayOfWeekSensor`` class.
This parameter was previously deprecated in favor of ``use_task_logical_date``.
The ``use_task_execution_day`` parameter has been removed from the ``DayOfWeekSensor`` class. This parameter was previously deprecated in favor of ``use_task_logical_date``.

If your code still uses ``use_task_execution_day``, you should update it to use ``use_task_logical_date``
instead to ensure compatibility with future Airflow versions.
@@ -16,3 +13,22 @@ Example update:
use_task_logical_date=True,
dag=dag,
)
* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] arguments ``use_task_execution_day`` → ``use_task_logical_date`` in ``airflow.operators.weekday.DayOfWeekSensor``
15 changes: 12 additions & 3 deletions newsfragments/41394.significant.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,15 @@
**Breaking Change**
The ``airflow.models.taskMixin.TaskMixin`` class has been removed. It was previously deprecated in favor of the ``airflow.models.taskMixin.DependencyMixin`` class.

The ``airflow.models.taskMixin.TaskMixin`` class has been removed. It was previously
deprecated in favor of the ``airflow.models.taskMixin.DependencyMixin`` class.
If your code relies on ``TaskMixin``, please update it to use ``DependencyMixin`` instead
to ensure compatibility with Airflow 3.0 and beyond.

* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
23 changes: 23 additions & 0 deletions newsfragments/41395.significant.rst
Original file line number Diff line number Diff line change
@@ -8,3 +8,26 @@ The following deprecated functions, constants, and classes have been removed as
- ``airflow.utils.file.mkdirs`` function: Use ``pathlib.Path.mkdir`` instead.
- ``airflow.utils.state.SHUTDOWN`` state: No action needed; this state is no longer used.
- ``airflow.utils.state.terminating_states`` constant: No action needed; this constant is no longer used.

* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] ``airflow.utils.file.TemporaryDirectory`` → ``tempfile.TemporaryDirectory``
* [x] ``airflow.utils.file.mkdirs`` → ``pathlib.Path({path}).mkdir``
* [x] ``airflow.utils.dag_cycle_tester.test_cycle``
* [x] ``airflow.utils.state.SHUTDOWN``
* [x] ``airflow.utils.state.terminating_states``
13 changes: 11 additions & 2 deletions newsfragments/41420.significant.rst
Original file line number Diff line number Diff line change
@@ -1,5 +1,3 @@
**Breaking Change**

Replaced Python's ``list`` with ``MutableSet`` for the property ``DAG.tags``.

At the constractur you still can use list,
@@ -9,3 +7,14 @@ you actually can use any data structure that implements the
The ``tags`` property of the ``DAG`` model would be of type
``MutableSet`` instead of ``list``,
as there are no actual duplicates at the tags.

* Types of change

* [ ] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
13 changes: 11 additions & 2 deletions newsfragments/41434.significant.rst
Original file line number Diff line number Diff line change
@@ -1,6 +1,15 @@
Experimental API is removed

**Breaking Change**

Experimental API is no longer available in Airflow. Users
should transition to using Rest API as an alternative.

* Types of change

* [ ] Dag changes
* [ ] Config changes
* [x] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
42 changes: 27 additions & 15 deletions newsfragments/41440.significant.rst
Original file line number Diff line number Diff line change
@@ -1,16 +1,28 @@
Removed unused methods / properties in models/dag.py
Removed unused methods / properties in ``airflow/models/dag.py``

Methods removed:
* date_range
* is_fixed_time_schedule
* next_dagrun_after_date
* get_run_dates
* normalize_schedule
* full_filepath
* concurrency
* filepath
* concurrency_reached
* normalized_schedule_interval
* latest_execution_date
* set_dag_runs_state
* bulk_sync_to_db
* Methods removed

* ``date_range``
* ``is_fixed_time_schedule``
* ``next_dagrun_after_date``
* ``get_run_dates``
* ``normalize_schedule``
* ``full_filepath``
* ``concurrency``
* ``filepath``
* ``concurrency_reached``
* ``normalized_schedule_interval``
* ``latest_execution_date``
* ``set_dag_runs_state``
* ``bulk_sync_to_db``

* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes
20 changes: 20 additions & 0 deletions newsfragments/41453.significant.rst
Original file line number Diff line number Diff line change
@@ -9,3 +9,23 @@ presentation purposes.
Since the DAG object no longer has the ``schedule_interval`` attribute,
OpenLineage facets that contain the ``dag`` key produced on Airflow 3.0 or
later will also no longer contain the field.

* Types of change

* [x] Dag changes
* [ ] Config changes
* [x] API changes
* [ ] CLI changes
* [x] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] arguments ``schedule_interval`` in ``DAG``
* [x] arguments ``timetable`` in ``DAG``
29 changes: 25 additions & 4 deletions newsfragments/41496.significant.rst
Original file line number Diff line number Diff line change
@@ -1,5 +1,26 @@
Removed deprecated methods in airflow/utils/dates.py
Removed deprecated methods in ``airflow/utils/dates.py``

Methods removed:
* date_range
* days_ago (Use ``pendulum.today('UTC').add(days=-N, ...)``)
* Methods removed

* ``date_range``
* ``days_ago`` (Use ``pendulum.today('UTC').add(days=-N, ...)``)

* Types of change

* [x] Dag changes
* [ ] Config changes
* [ ] API changes
* [ ] CLI changes
* [ ] Behaviour changes
* [ ] Plugin changes
* [ ] Dependency changes
* [ ] Code interface changes

* Migration rules needed

* ruff

* AIR302

* [x] ``airflow.utils.dates.date_range``
* [x] ``airflow.utils.dates.days_ago`` → ``pendulum.today("UTC").add(days=-N, ...)``
Loading

0 comments on commit d460972

Please sign in to comment.