[Llama] Use rocm ukernel when available + use num_layer for pkv.#381
Merged
raikonenfnu merged 1 commit intomainfrom Feb 1, 2024
Merged
[Llama] Use rocm ukernel when available + use num_layer for pkv.#381raikonenfnu merged 1 commit intomainfrom
raikonenfnu merged 1 commit intomainfrom
Commits
Commits on Jan 31, 2024
- committed
Stanley Winata