Skip to content

perf: Fail fast on empty query for BatchPrefillWithPagedKVCacheKernel#377

Draft
Yard1 wants to merge 1 commit intoflashinfer-ai:mainfrom Yard1:prefill_fail_fast
+12-5

Commits

Commits on Jul 17, 2024