Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add API endpoint to clear all presigned URLs #2437

Closed
tw4l opened this issue Feb 27, 2025 · 1 comment
Closed

Add API endpoint to clear all presigned URLs #2437

tw4l opened this issue Feb 27, 2025 · 1 comment
Assignees
@tw4l

Comments

@tw4l
Copy link
Member

tw4l commented Feb 27, 2025

This would be useful for switching replay to replica storage, as well as in other cases where we want to regenerate all presigned URLs.
@tw4l tw4l self-assigned this Feb 27, 2025
@tw4l tw4l moved this from Triage to Implementing in Webrecorder Projects Feb 27, 2025
@ikreymer ikreymer moved this from Implementing to Todo in Webrecorder Projects Feb 27, 2025
@tw4l tw4l mentioned this issue Feb 27, 2025
Closed
@tw4l tw4l moved this from Todo to Implementing in Webrecorder Projects Feb 27, 2025
@tw4l tw4l moved this from Implementing to In Review in Webrecorder Projects Feb 27, 2025
@ikreymer ikreymer mentioned this issue Mar 1, 2025
Merged
ikreymer added a commit that referenced this issue Mar 3, 2025
@ikreymer @tw4l
Better cacheing of presigned URLs + support for thumbnails (#2446)
702c9ab 
Overhauls URL presigning by:
- cache the presigned urls in a flat, separate mongodb collection which
has an expiring index
- update presigned urls if not found / expired automatically in index
- remove logic on storing presignedUrl in files
- support cacheing presigned URL for thumbnails.
- add endpoints to clear presigned urls for org or for all files in all
orgs (superadmin only)
- supersedes #2438, fix for #2437
- removes previous presignedUrl and expireAt data from crawls and QA
runs

---------

Co-authored-by: Tessa Walsh <tessa@bitarchivist.net>
@ikreymer
Copy link
Member

ikreymer commented Mar 4, 2025 •
edited
Loading

Added via #2446 /api/orgs/clear-presigned-urls and /api/orgs/<org>/clear-presigned-urls in 1.14.3

@ikreymer ikreymer closed this as completed Mar 4, 2025
@github-project-automation github-project-automation bot moved this from In Review to Done! in Webrecorder Projects Mar 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tw4l tw4l

Labels
None yet
Projects
Webrecorder Projects
Status: Done!
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add superadmin API endpoint to clear all presigned URLs webrecorder/browsertrix
2 participants
@ikreymer @tw4l