unify xpu and cpu backend and use paged attention#1009

Merged

IlyasMoutawwakil merged 32 commits intomainfrom paged_attn

Dec 5, 2024

+1,035-860

Commits on Oct 9, 2024

Commits on Oct 10, 2024

Commits on Oct 17, 2024

refine class IPEXPagedCache's update method (#945 )
kaixuanliu
authored

Commits on Oct 18, 2024

fix bug when doing beam search (#954 )
kaixuanliu
authored

Commits on Oct 23, 2024

Commits on Oct 24, 2024

optimize cache ops in xpu, improve for beam search
sywangyi
committed

Commits on Nov 5, 2024

enable gpt2, falcon has core dump error in PagedAttention.single_quer… (#979 )
jiqing-feng
authored

Commits on Nov 13, 2024

fix unit test case, CPU part is OK; Enable Falcon7b for XPU (#992 )
kaixuanliu
authored

Commits on Nov 25, 2024

Commits on Nov 26, 2024

Commits on Nov 27, 2024

Commits on Dec 2, 2024

Commits on Dec 3, 2024

Fix tests (#1047 )
jiqing-feng
authored

Commits on Dec 5, 2024

Patch gpt2 block forward for passing input_lens. (#1050 )
jiqing-feng
authored