Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add superadmin API endpoint to clear all presigned URLs #2438

Closed
wants to merge 8 commits into from

Conversation

tw4l
Copy link
Member

@tw4l tw4l commented Feb 27, 2025

Fixes #2437

Adds two new superadmin-only API endpoint to clear presigned URLs for all crawl/upload WACZs as well as all QA analysis run WACZs:

  • One for all orgs
  • One limited to specific org

@tw4l tw4l requested a review from ikreymer February 27, 2025 21:39
@ikreymer
Copy link
Member

ikreymer commented Mar 1, 2025

#2446 provides a simplified implementation to presigning, and a simpler way to clear presigned URLs, so probably should supersede this if we go with that..

ikreymer added a commit that referenced this pull request Mar 3, 2025
Overhauls URL presigning by:
- cache the presigned urls in a flat, separate mongodb collection which
has an expiring index
- update presigned urls if not found / expired automatically in index
- remove logic on storing presignedUrl in files
- support cacheing presigned URL for thumbnails.
- add endpoints to clear presigned urls for org or for all files in all
orgs (superadmin only)
- supersedes #2438, fix for #2437
- removes previous presignedUrl and expireAt data from crawls and QA
runs

---------

Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
@ikreymer
Copy link
Member

ikreymer commented Mar 3, 2025

Closed in favor of #2446

@ikreymer ikreymer closed this Mar 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add API endpoint to clear all presigned URLs
2 participants