-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Pull requests: sgl-project/sglang
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[Feature] DeepSeek V3/R1 INT8 Quantization (channel-wise)
#3888
opened Feb 26, 2025 by
HandH1998
Loading…
6 tasks done
Add examples for token in token out for LLM
#3886
opened Feb 26, 2025 by
blacker521
Loading…
1 of 6 tasks
[block_wise w8a8]Add block_wise w8w8 tunning scripts
#3873
opened Feb 26, 2025 by
coolhok
Loading…
2 of 6 tasks
Fix bench_serving not recognizing OPENAI_API_KEY
#3870
opened Feb 26, 2025 by
kebe7jun
Loading…
2 of 6 tasks
[feat] Add Vertex AI compatible prediction route for /generate
#3866
opened Feb 26, 2025 by
KCFindstr
Loading…
5 of 6 tasks
Fix block_shape in benchmark_vllm_vs_sglang_fused_moe_triton.py
#3858
opened Feb 25, 2025 by
zifeitong
Loading…
6 tasks done
Fix scripts/killall_sglang.sh and improve scripts/ci_install_dependency.sh
#3851
opened Feb 25, 2025 by
merrymercy
Loading…
Update FP8 kernel configuration for 4xGPU support on AMD
#3850
opened Feb 25, 2025 by
Eliovp
Loading…
[docs] Update outdated description about
torch.compile
#3844
opened Feb 25, 2025 by
junliu-mde
Loading…
2 of 6 tasks
[Doc] Fix typo in backend/sampling_params
#3835
opened Feb 25, 2025 by
yang-ybb
Loading…
2 of 6 tasks
[BugFix]: Add type check before compare for max_new_tokens
#3832
opened Feb 25, 2025 by
YangZeyu95
Loading…
1 of 6 tasks
[feat] add small vocab table for eagle's draft model.
#3822
opened Feb 24, 2025 by
Zhou-sx
Loading…
1 of 6 tasks
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.