Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add additional checksum algorithms in mountpoint-s3-crt crate #1082

Merged
merged 11 commits into from
Oct 28, 2024

Conversation

dannycjones
Copy link
Contributor

@dannycjones dannycjones commented Oct 24, 2024

Description of change

We want to provide bindings to some of the checksum algorithms provided by the AWS CRT. In particular, it may be interesting to see how these checksum algorithms compare for things like the internal checksumming we perform on the read path of Mountpoint file system. The performance of CRC64 versus our current CRC32C looks promising!

This change provides bindings for all algorithms exposed by the AWS CRT today.

Relevant issues: N/A

Does this change impact existing behavior?

It removes the implementation of std::hash::Hasher on the checksum/digest algorithms. We do not depend on this in Mountpoint itself, but this will be called out in the change log for any consumers of the crates.

Does this change need a changelog entry in any of the crates?

This adds new bindings. This has been noted in the mountpoint-s3-crt changelog.


By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and I agree to the terms of the Developer Certificate of Origin (DCO).

passaro and others added 9 commits October 24, 2024 15:41
Signed-off-by: Alessandro Passaro <alexpax@amazon.co.uk>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
@dannycjones dannycjones changed the title Add bindings for additional checksum algorithms in mountpoint-s3-crt crate Add additional checksum algorithms in mountpoint-s3-crt crate Oct 24, 2024
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
Signed-off-by: Daniel Carl Jones <djonesoa@amazon.com>
@dannycjones dannycjones marked this pull request as ready for review October 28, 2024 13:51
Copy link
Contributor

@passaro passaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@dannycjones dannycjones added this pull request to the merge queue Oct 28, 2024
Merged via the queue into awslabs:main with commit 05a50da Oct 28, 2024
23 checks passed
@dannycjones dannycjones deleted the bind-additional-checksum-algos branch October 28, 2024 18:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants