Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Image Cache #1114

Merged
merged 25 commits into from
Sep 28, 2024
Merged

Image Cache #1114

merged 25 commits into from
Sep 28, 2024

Commits on Sep 20, 2024

  1. Remove content_harvester.content_types Media and Thumbnail

    @amywieliczka
    amywieliczka committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    83ce1d5 View commit details
    Browse the repository at this point in the history

  2. rename 'cache' to be more descriptive

    @amywieliczka
    amywieliczka committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    f3f42f9 View commit details
    Browse the repository at this point in the history

  3. Create a separate download_media function

    @amywieliczka
    amywieliczka committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    1105c7e View commit details
    Browse the repository at this point in the history

  4. Move in-memory download cache management into a decorator

    @amywieliczka
    amywieliczka committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    584dca4 View commit details
    Browse the repository at this point in the history

  5. Wrap download_thumbnail in the same in-memory download cache

    @amywieliczka
    amywieliczka committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    940afea View commit details
    Browse the repository at this point in the history

  6. Stop using md5 as proxy for successful download to local filesystem

    @amywieliczka
    amywieliczka committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    0ec29c1 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Use response content type rather than Nuxeo mimetype

    @amywieliczka
    amywieliczka committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    fb922ea View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Remove re-generating md5 of derivatives

    @amywieliczka
    amywieliczka committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    cbbccf2 View commit details
    Browse the repository at this point in the history

  2. Caching! ✨ draft: no backend, complex keys, no decorator 

    This is a great place to look to understand how the two
content harvester caches work, though.
    @amywieliczka
    amywieliczka committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5fa3b9f View commit details
    Browse the repository at this point in the history

  3. Factor out download_url and wrap in lru_cache

    @amywieliczka
    amywieliczka committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    256f627 View commit details
    Browse the repository at this point in the history

  4. Centralize raising exception for auth over http

    @amywieliczka
    amywieliczka committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    290d85e View commit details
    Browse the repository at this point in the history

  5. Create a content_component_cache decorator

    @amywieliczka
    amywieliczka committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    7a0f50a View commit details
    Browse the repository at this point in the history

  6. Rearrange data structures & naming

    @amywieliczka
    amywieliczka committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    051a3cb View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Generate cache key once

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    c0c66c4 View commit details
    Browse the repository at this point in the history

  2. Remove upload cache - this was ported from md5s3stash unnecessarily

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    982b93f View commit details
    Browse the repository at this point in the history

  3. Add an s3 cache backend to the content_harvester

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    1745d17 View commit details
    Browse the repository at this point in the history

  4. Handle exceptions clearly

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    5b2bd11 View commit details
    Browse the repository at this point in the history

  5. S3Cache - Add prefix feature

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    b5c1fbe View commit details
    Browse the repository at this point in the history

  6. Set s3 cache check optional on config CONTENT_COMPONENT_CACHE

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    8dc3faa View commit details
    Browse the repository at this point in the history

  7. Bug squashing...

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    2d16abd View commit details
    Browse the repository at this point in the history

  8. Don't cache if no ETag or Last-Modified headers

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    58b84e5 View commit details
    Browse the repository at this point in the history

  9. Only warn once if persistent cache not configured

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    56b215c View commit details
    Browse the repository at this point in the history

  10. Update readme, env.example, add prefix parsing

    @amywieliczka
    amywieliczka committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    6a3705b View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Indexing: remove fields not in opensearch schema

    @amywieliczka
    amywieliczka committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    bafb18f View commit details
    Browse the repository at this point in the history

  2. wrap as f-string for safety

    @amywieliczka
    amywieliczka committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    aa0b0fc View commit details
    Browse the repository at this point in the history