Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create file system based BlobSidecar data archive #8674

Open
wants to merge 36 commits into
base: master
Choose a base branch
from
Open

Create file system based BlobSidecar data archive #8674

wants to merge 36 commits into from

Commits on Oct 2, 2024

  1. WIP. Moving things around and preparing FileSystemArchive to write Bl… 

    …obSidecars.
    @david-ry4n
    david-ry4n committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    13bf6a9 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. WIP. spotlessApply

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    0d21bfa View commit details
    Browse the repository at this point in the history

  2. WIP. Setup configuration.

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    7f9c7d1 View commit details
    Browse the repository at this point in the history

  3. WIP. Add command line option.

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    34dd6bc View commit details
    Browse the repository at this point in the history

  4. WIP. More spotlessApply

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    7cbfd4b View commit details
    Browse the repository at this point in the history

  5. WIP.Clean up for DataArchiveNoopWriter.

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    7f839cb View commit details
    Browse the repository at this point in the history

  6. WIP. A few fixes.

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    fea1758 View commit details
    Browse the repository at this point in the history

  7. WIP. Writing test case and working on JsonWriter.

    @david-ry4n
    david-ry4n committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    bb14b6a View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. WIP. Switching to writing List<BlobSidecar>

    @david-ry4n
    david-ry4n committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    a77a5ac View commit details
    Browse the repository at this point in the history

  2. Rewrite pruneBlobSidecars to group BlobSlidecars to slots. Still need… 

    …s work.
    @david-ry4n
    david-ry4n committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    f41519e View commit details
    Browse the repository at this point in the history

  3. serialise to the output stream.

    @david-ry4n
    david-ry4n committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    2bb95cd View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. improve the archiveAndPrune code.

    @david-ry4n
    david-ry4n committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    2e32d2d View commit details
    Browse the repository at this point in the history

  2. Fix errors in test case.

    @david-ry4n
    david-ry4n committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    88b3a8f View commit details
    Browse the repository at this point in the history

  3. Fix errors in test case.

    @david-ry4n
    david-ry4n committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    d99c445 View commit details
    Browse the repository at this point in the history

  4. spotless.

    @david-ry4n
    david-ry4n committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    395e9d9 View commit details
    Browse the repository at this point in the history

  5. Fixing tests

    @david-ry4n
    david-ry4n committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    1a16355 View commit details
    Browse the repository at this point in the history

  6. Fixing tests.

    @david-ry4n
    david-ry4n committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    dd27197 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Code cleanup and add archive to non-canonical calls.

    @david-ry4n
    david-ry4n committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b951071 View commit details
    Browse the repository at this point in the history

  2. Additional tests and clean up.

    @david-ry4n
    david-ry4n committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    8e6f940 View commit details
    Browse the repository at this point in the history

  3. appeasing the code reviewer.

    @david-ry4n
    david-ry4n committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4bb0835 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into create-filesystem-dataarchive

    @david-ry4n
    david-ry4n authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    c5d73ac View commit details
    Browse the repository at this point in the history

  5. remove potential file handle leak.

    @david-ry4n
    david-ry4n committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    4243e89 View commit details
    Browse the repository at this point in the history

  6. Fixing windows test.

    @david-ry4n
    david-ry4n committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    e04f4a9 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Change config and error message.

    @david-ry4n
    david-ry4n committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    af9714b View commit details
    Browse the repository at this point in the history

  2. Make integration test also validated blob archiving.

    @david-ry4n
    david-ry4n committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    095f003 View commit details
    Browse the repository at this point in the history

  3. Fix refactor change.

    @david-ry4n
    david-ry4n committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    eaee480 View commit details
    Browse the repository at this point in the history

  4. spotless checks.

    @david-ry4n
    david-ry4n committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    199abbb View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into create-filesystem-dataarchive

    @david-ry4n
    david-ry4n authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    b0a42c6 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Incorporate feedback for JsonWriter using schema from BlobSidecar. Re… 

    …moves need to pass around Spec.
    @david-ry4n
    david-ry4n committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    c5ba407 View commit details
    Browse the repository at this point in the history

  2. Fix to satisfy checks.

    @david-ry4n
    david-ry4n committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    74a7611 View commit details
    Browse the repository at this point in the history

  3. adding final keyword.

    @david-ry4n
    david-ry4n committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    4255cb1 View commit details
    Browse the repository at this point in the history

  4. Update default for Bobs pruning limit.

    @david-ry4n
    david-ry4n committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    5e77c1b View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into create-filesystem-dataarchive

    @david-ry4n
    david-ry4n authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    bf7f0a2 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Adding a config test.

    @david-ry4n
    david-ry4n committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    358d4b9 View commit details
    Browse the repository at this point in the history

  2. Get the case right!

    @david-ry4n
    david-ry4n committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    44c3803 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into create-filesystem-dataarchive

    @david-ry4n
    david-ry4n authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a88e4c4 View commit details
    Browse the repository at this point in the history