PR #15331: Support cuDNN frontend scaled dot product attention for FP8. Part- 2(backward) #18100
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![copybara-service[bot]](https://avatars.githubusercontent.com/in/44061?s=60&v=4){kind=small}
copybara-service
bot
force-pushed
the
test_684025541
branch
2 times, most recently
from
fab1b65
to
9952c2b
Compare
…8. Part- 2(backward) Imported from GitHub PR #15331 As the 2nd part of #15092. NOTE: this feature relies on cudnn-frontend v1.6.1 which is not in XLA yet. Copybara import of the project: -- 06db3c8 by shuw <shuw@nvidia.com>: Scaled dot product attention implementation by cudnn. -- 937b0e2 by shuw <shuw@nvidia.com>: Improve after review 1 -- 398b2ba by shuw <shuw@nvidia.com>: clang-format -- 0825789 by Shu Wang <shuw@nvidia.com>: fix typo. -- d0ae3cf by shuw <shuw@nvidia.com>: Refactor test Merging this change closes #15331 COPYBARA_INTEGRATE_REVIEW=#15331 from wenscarl:sdpa_fp8_bwd d0ae3cf PiperOrigin-RevId: 684062495
copybara-service
bot
force-pushed
the
test_684025541
branch
from
9952c2b
to
467563e
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR #15331: Support cuDNN frontend scaled dot product attention for FP8. Part- 2(backward)
Imported from GitHub PR #15331
As the 2nd part of #15092.
NOTE: this feature relies on cudnn-frontend v1.6.1 which is not in XLA yet.
Copybara import of the project:
--
06db3c8 by shuw shuw@nvidia.com:
Scaled dot product attention implementation by cudnn.
--
937b0e2 by shuw shuw@nvidia.com:
Improve after review 1
--
398b2ba by shuw shuw@nvidia.com:
clang-format
--
0825789 by Shu Wang shuw@nvidia.com:
fix typo.
d0ae3cf by shuw shuw@nvidia.com:
Refactor test
Merging this change closes #15331
FUTURE_COPYBARA_INTEGRATE_REVIEW=#15331 from wenscarl:sdpa_fp8_bwd d0ae3cf