Fix block allocation for multi-token decode (speculative decoding)#250
Open
brucechanglongxu wants to merge 1 commit intoROCm:mainfrom
Open
Fix block allocation for multi-token decode (speculative decoding)#250brucechanglongxu wants to merge 1 commit intoROCm:mainfrom
brucechanglongxu wants to merge 1 commit intoROCm:mainfrom