[Epic] Scraping Features

[sarahsturgeon]

I want people to be able to scrape the mirror super easily, even if the main site is down or whatever.

Ideally, we could serve a number of different json files:

• One for each tag
• One for each category
• One for all pages

And then allow people to query multiple at a time.

For self hosting, this will inflate the total image size by quite a bit.. maybe 100+mb which could nearly double the final size. Maybe we can exclude this from self hosted?

For the live site, it should be fine - it'll just be a number of R2 reads, which are super cheap and cache-able.