Skip to content

Pull requests: sgl-project/sglang

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Sort

Pull requests list

add deepgemm and sglang fp8 block-wise gemm benchmark
#3893 opened Feb 26, 2025 by BBuf Loading…
[Feature] DeepSeek V3/R1 INT8 Quantization (channel-wise)
#3888 opened Feb 26, 2025 by HandH1998 Loading…
6 tasks done
Add examples for token in token out for LLM
#3886 opened Feb 26, 2025 by blacker521 Loading…
1 of 6 tasks
[Quantization] support VPTQ
#3879 opened Feb 26, 2025 by wejoncy Draft
6 tasks
Update router.rs
#3877 opened Feb 26, 2025 by kuaikuai Loading…
[block_wise w8a8]Add block_wise w8w8 tunning scripts
#3873 opened Feb 26, 2025 by coolhok Loading…
2 of 6 tasks
Fix bench_serving not recognizing OPENAI_API_KEY
#3870 opened Feb 26, 2025 by kebe7jun Loading…
2 of 6 tasks
[feat] Add Vertex AI compatible prediction route for /generate
#3866 opened Feb 26, 2025 by KCFindstr Loading…
5 of 6 tasks
Fix the doc link for sampling params
#3861 opened Feb 26, 2025 by Qiaolin-Yu Loading…
6 tasks
Feature/improve docs
#3860 opened Feb 25, 2025 by simveit Draft
Reasoning parser
#3859 opened Feb 25, 2025 by ShaoZhang0115 Loading…
1 of 6 tasks
Fix block_shape in benchmark_vllm_vs_sglang_fused_moe_triton.py
#3858 opened Feb 25, 2025 by zifeitong Loading…
6 tasks done
[Feature] Support for Ascend NPU backend
#3853 opened Feb 25, 2025 by botieking98 Loading…
6 tasks
SGLang + Verl
#3852 opened Feb 25, 2025 by fzyzcjy Loading…
6 tasks
Update FP8 kernel configuration for 4xGPU support on AMD
#3850 opened Feb 25, 2025 by Eliovp Loading…
[docs] Update outdated description about torch.compile
#3844 opened Feb 25, 2025 by junliu-mde Loading…
2 of 6 tasks
add doc for uv install
#3838 opened Feb 25, 2025 by YQ-Wang Loading…
2 of 6 tasks
[Doc] Fix typo in backend/sampling_params
#3835 opened Feb 25, 2025 by yang-ybb Loading…
2 of 6 tasks
Resolve LinearBase circular import
#3833 opened Feb 25, 2025 by zhengy001 Loading…
2 of 6 tasks
[BugFix]: Add type check before compare for max_new_tokens
#3832 opened Feb 25, 2025 by YangZeyu95 Loading…
1 of 6 tasks
Fix nightly-test CI
#3826 opened Feb 24, 2025 by yinfan98 Loading…
1 of 6 tasks
[feat] add small vocab table for eagle's draft model.
#3822 opened Feb 24, 2025 by Zhou-sx Loading…
1 of 6 tasks
ProTip! Type g i on any issue or pull request to go back to the issue listing page.