Skip to content

Commit b63ba84

Browse files
authored
[ROCm][bugfix] scpecilative decoding worker class (vllm-project#11035)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
1 parent 9c6459e commit b63ba84

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

vllm/platforms/rocm.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -93,6 +93,8 @@ def check_and_update_config(cls, vllm_config: VllmConfig) -> None:
9393
elif vllm_config.speculative_config:
9494
parallel_config.worker_cls = \
9595
"vllm.spec_decode.spec_decode_worker.create_spec_worker"
96+
parallel_config.sd_worker_cls = \
97+
"vllm.worker.worker.Worker"
9698
else:
9799
parallel_config.worker_cls = "vllm.worker.worker.Worker"
98100

0 commit comments

Comments
 (0)