Code

Dev/use vllm#1053

Code

Merged

lyblsgo merged 7 commits intoFunAudioLLM:dev/CometFunAudioLLM/CosyVoice:dev/Cometfrom qi-hua:dev/use_vllmqi-hua/CosyVoice:dev/use_vllmCopy head branch name to clipboardMar 13, 2025

Commits

Commits on Mar 7, 2025

• 初步合并vllm支持，异步推理的通道处理还存在bug

  qi-hua

  committed
  90b666e

  Copy full SHA for 90b666e

• refactor(llm): 重构 VLLM 推理方式

  Show description for d4d187b
  qi-hua

  committed
  d4d187b

  Copy full SHA for d4d187b

• refactor(llm): 移除未使用的异步推理方法

  Show description for 2fbeba5
  qi-hua

  committed
  2fbeba5

  Copy full SHA for 2fbeba5

• chore: 新增 requirements_vllm.txt 文件，指定VLLM 模型所需的依赖

  qi-hua

  committed
  a1314e5

  Copy full SHA for a1314e5

• docs: 添加speed_test.ipynb文件

  Show description for b4fe05d
  qi-hua

  committed
  b4fe05d

  Copy full SHA for b4fe05d

Commits on Mar 8, 2025

• refactor(llm): 重构 vLLM 推理任务处理方式，支持多任务处理

  Show description for ab5b8eb
  qi-hua

  committed
  ab5b8eb

  Copy full SHA for ab5b8eb

• fix(async_cosyvoice): 恢复原本文本令牌处理逻辑

  Show description for c0f6a47
  qi-hua

  committed
  c0f6a47

  Copy full SHA for c0f6a47