Skip to content

vllm

Latest
Compare
Choose a tag to compare
@luguoyixiazi luguoyixiazi released this 01 Dec 14:42
05907fe

vllm编译,
torch-2.4.0
cuda 11.8
byd一把torch2.5.1的api,麻麻滴,光编译也不顶用哈
1.报错AttributeError: module 'torch._inductor' has no attribute 'config'
注释掉python3.10/site-packages/vllm/plugins/init.py的torch._inductor.config.compile_threads = 1