Pinned Loading

1. hao-ai-lab/Dynasor hao-ai-lab/Dynasor Public

   Simple extension on vLLM to help you speed up reasoning model without training.

   Jupyter Notebook 76 8

2. LLMServe/DistServe LLMServe/DistServe Public

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook 467 50

3. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 38.6k 5.8k