Flash Attention Support #65
matrixportalx
started this conversation in
Ideas
Replies: 2 comments 2 replies
-
|
In addition, in order to be able to copy and edit user messages and model response, there must be "copy", "edit" buttons. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Noted ✅ |
Beta Was this translation helpful? Give feedback.
-
|
Hey @matrixportalx |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thank you so much @Siddhesh2377 😊👍 |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
It will be great if you add Flash Attention to the app. I think flash attention on phones like Snapdragon 7 makes a obvious difference in speed. An option to enable Flash Attention in the Settings menu and also will be very useful.
Many new features you add to the app provide more functions. I wish you success in your work and a practice that I love. Nice work. 👍
Beta Was this translation helpful? Give feedback.
All reactions