Skip to content

Commit

Permalink
Remove trim_and_deduplicate_tags DAG after successful run (no longe…
Browse files Browse the repository at this point in the history
…r needed) (#4557)
  • Loading branch information
sarayourfriend authored Jun 26, 2024
1 parent 1b0f3a7 commit 17e7f3d
Show file tree
Hide file tree
Showing 2 changed files with 0 additions and 101 deletions.
88 changes: 0 additions & 88 deletions catalog/dags/maintenance/trim_and_deduplicate_tags.py

This file was deleted.

13 changes: 0 additions & 13 deletions documentation/catalog/reference/DAGs.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,6 @@ The following are DAGs grouped by their primary tag:
| [`recreate_image_popularity_calculation`](#recreate_media_type_popularity_calculation) | `None` |
| [`report_pending_reported_media`](#report_pending_reported_media) | `@weekly` |
| [`staging_database_restore`](#staging_database_restore) | `@monthly` |
| [`trim_and_deduplicate_tags`](#trim_and_deduplicate_tags) | `None` |

### Elasticsearch

Expand Down Expand Up @@ -177,7 +176,6 @@ The following is documentation associated with each DAG (where available):
1. [`smk_workflow`](#smk_workflow)
1. [`staging_database_restore`](#staging_database_restore)
1. [`stocksnap_workflow`](#stocksnap_workflow)
1. [`trim_and_deduplicate_tags`](#trim_and_deduplicate_tags)
1. [`wikimedia_commons_workflow`](#wikimedia_commons_workflow)
1. [`wikimedia_reingestion_workflow`](#wikimedia_commons_workflow)
1. [`wordpress_workflow`](#wordpress_workflow)
Expand Down Expand Up @@ -1087,17 +1085,6 @@ authorization required. API is undocumented.

----

### `trim_and_deduplicate_tags`

See the issue for context and motivation:
https://github.com/WordPress/openverse/issues/4199

This DAG triggers a run of the batched update DAG. It generates a new list of
tags by trimming all existing tags and re-inserting only the distinct tags of
the resulting list of tags.

----

### `wikimedia_commons_workflow`

**Content Provider:** Wikimedia Commons
Expand Down

0 comments on commit 17e7f3d

Please sign in to comment.