@@ -44,6 +44,7 @@ The following are DAGs grouped by their primary tag:
44
44
| DAG ID | Schedule Interval |
45
45
| --------------------------------------------------------------------------------- | ----------------- |
46
46
| [ ` batched_update ` ] ( #batched_update ) | ` None ` |
47
+ | [ ` catalog_cleaner ` ] ( #catalog_cleaner ) | ` None ` |
47
48
| [ ` delete_records ` ] ( #delete_records ) | ` None ` |
48
49
| [ ` recreate_audio_popularity_calculation ` ] ( #recreate_audio_popularity_calculation ) | ` None ` |
49
50
| [ ` recreate_full_staging_index ` ] ( #recreate_full_staging_index ) | ` None ` |
@@ -126,6 +127,7 @@ The following is documentation associated with each DAG (where available):
126
127
1 . [ ` audio_data_refresh ` ] ( #audio_data_refresh )
127
128
1 . [ ` audio_popularity_refresh ` ] ( #audio_popularity_refresh )
128
129
1 . [ ` batched_update ` ] ( #batched_update )
130
+ 1 . [ ` catalog_cleaner ` ] ( #catalog_cleaner )
129
131
1 . [ ` cc_mixter_workflow ` ] ( #cc_mixter_workflow )
130
132
1 . [ ` check_silenced_dags ` ] ( #check_silenced_dags )
131
133
1 . [ ` create_filtered_audio_index ` ] ( #create_filtered_audio_index )
@@ -317,6 +319,13 @@ used when the DagRun configuration needs to be changed after the table was
317
319
already created: for example, if there was a problem with the ` update_query `
318
320
which caused DAG failures during the ` update_batches ` step.
319
321
322
+ ### ` catalog_cleaner `
323
+
324
+ Catalog Data Cleaner DAG
325
+
326
+ Use CSV files created during the clean step of the ingestion process to bring
327
+ the changes into the catalog.
328
+
320
329
### ` cc_mixter_workflow `
321
330
322
331
Content Provider: ccMixter
0 commit comments