-
Notifications
You must be signed in to change notification settings - Fork 156
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Blake3 support #710
Comments
The main blocker to adding support for BLAKE3 is that we need to consider if an update to the cache directory format is required, since the current format does not explicitly say what digest function the blobs are stored in. If it is safe to assume that we will never encounter digest collisions between SHA256 and BLAKE3, then maybe we can keep the current format unchanged. If that's the case then maybe it's OK for bazel-remote to not care what the format of on-disk blobs are. (Aside: I think someone mentioned that BLAKE3 is only fast on amd64. Something to bear in mind.) |
I think it's a safe assumption that BLAKE3 and SHA256 would not have a digest collision. However, I think there are some assumptions that sha256 is the only hashing algorithm for bazel. Example: Line 138 in 0fd6a44
However, there are new fields in the protos that explain which digest function is used, so it would be trivial to add the appropriate paths for BLAKE3. |
I tried using blake3 with bazel-remote and it works fine when I disable remote cache compression. To be precise, i needed to set storage mode to 'uncompressed' in bazel-remote. However, if I set it to zstd than it stops working. |
Bazel now supports blake3 as a hashing algorithm. It'd be great if we could start using it with bazel-remote as it promises impressive perfomance boosts
The text was updated successfully, but these errors were encountered: