Skip to content

Commit 754b654

Browse files
committed
Generate DAG docs
1 parent d0a284e commit 754b654

File tree

1 file changed

+9
-0
lines changed
  • documentation/catalog/reference

1 file changed

+9
-0
lines changed

documentation/catalog/reference/DAGs.md

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -44,6 +44,7 @@ The following are DAGs grouped by their primary tag:
4444
| DAG ID | Schedule Interval |
4545
| --------------------------------------------------------------------------------- | ----------------- |
4646
| [`batched_update`](#batched_update) | `None` |
47+
| [`catalog_cleaner`](#catalog_cleaner) | `None` |
4748
| [`delete_records`](#delete_records) | `None` |
4849
| [`recreate_audio_popularity_calculation`](#recreate_audio_popularity_calculation) | `None` |
4950
| [`recreate_full_staging_index`](#recreate_full_staging_index) | `None` |
@@ -126,6 +127,7 @@ The following is documentation associated with each DAG (where available):
126127
1. [`audio_data_refresh`](#audio_data_refresh)
127128
1. [`audio_popularity_refresh`](#audio_popularity_refresh)
128129
1. [`batched_update`](#batched_update)
130+
1. [`catalog_cleaner`](#catalog_cleaner)
129131
1. [`cc_mixter_workflow`](#cc_mixter_workflow)
130132
1. [`check_silenced_dags`](#check_silenced_dags)
131133
1. [`create_filtered_audio_index`](#create_filtered_audio_index)
@@ -317,6 +319,13 @@ used when the DagRun configuration needs to be changed after the table was
317319
already created: for example, if there was a problem with the `update_query`
318320
which caused DAG failures during the `update_batches` step.
319321

322+
### `catalog_cleaner`
323+
324+
Catalog Data Cleaner DAG
325+
326+
Use CSV files created during the clean step of the ingestion process to bring
327+
the changes into the catalog.
328+
320329
### `cc_mixter_workflow`
321330

322331
Content Provider: ccMixter

0 commit comments

Comments
 (0)