Skip to content

Issues: sgl-project/sglang

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

303 Open 954 Closed
303 Open 954 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] H20 8 gpu x 2 with --enable-dp-attention occurred CUDA error: an illegal memory access
#3892 opened Feb 26, 2025 by mahaocong90
5 tasks done
[Bug] Dimension mismatched error when capturing cuda graph while enabling NEXTN
#3891 opened Feb 26, 2025 by TangChangcheng
5 tasks done
[Bug] --dp-size issue with AMD 8xMI300X and Llama 3.1 70B
#3890 opened Feb 26, 2025 by RonanKMcGovern
5 tasks done
[Bug]
#3889 opened Feb 26, 2025 by zzjSteven
5 tasks
@minleminzui
[Bug] An error occurred when running the deepseek r1 awq model
#3887 opened Feb 26, 2025 by luhairong11
5 tasks done
@minleminzui
1
[Feature] Decord to torchcode
#3885 opened Feb 26, 2025 by johnnynunez
2 tasks done
@minleminzui
what's the difference for speculative-eagle-topk speculative-num-draft-tokens
#3883 opened Feb 26, 2025 by WeiboXu
@minleminzui
[Bug] Qwen2.5-VL-AWQ dose not support concurrent request
#3882 opened Feb 26, 2025 by Jalen-Zhong
5 tasks done
@minleminzui
1
[Feature] Support Deepseek's DeepGemm MoE
#3881 opened Feb 26, 2025 by gzy19990617
2 tasks done
@minleminzui
4
[Feature] Run DeepSeek V3 W4-only
#3880 opened Feb 26, 2025 by QingshuiL
2 tasks done
@minleminzui
2
[Bug] ImportError: cannot import name 'is_valid_list_of_images' from transformers.models.mllama.image_processing_mllama
#3878 opened Feb 26, 2025 by AndrewTsao
5 tasks done
@minleminzui
2
[Bug] Frontend compatibility with Python 3.13
#3876 opened Feb 26, 2025 by stevapple
4 of 5 tasks
@minleminzui
[Feature] Add examples for token in token out for LLM documentation Improvements or additions to documentation good first issue Good for newcomers help wanted Extra attention is needed
#3872 opened Feb 26, 2025 by zhaochenyang20
2 tasks done
@blacker521 @attack204 @zhaochenyang20
2
[Feature] Support token-in-token-out for Vision LM RLHF Using SGLang for post training visIon-LM
#3871 opened Feb 26, 2025 by zhaochenyang20
2 tasks done
@zhaochenyang20
5
[Bug] bench_serving can not bench sglang with api_key auth
#3869 opened Feb 26, 2025 by kebe7jun
5 tasks done
1
[Bug] When running the DeepSeekV3 model with the bf16 data type, the torch.compile operation did not take effect.
#3868 opened Feb 26, 2025 by thisjiang
4 of 5 tasks
@Fridge003
1
How to analyze the time consumption of prefill and decoding stages separately
#3856 opened Feb 25, 2025 by CodeLiu666
@Fridge003
2
[Bug] get not run docker into container
#3855 opened Feb 25, 2025 by zlwu92
5 tasks
@Fridge003
1
[Bug] Slower TTFT Performance help wanted Extra attention is needed
#3854 opened Feb 25, 2025 by wahaha22
5 tasks done
@zhaochenyang20
3
[DeepseekR1]How ragged prefill manage kv_cache?
#3849 opened Feb 25, 2025 by AlvL1225
@minleminzui
3
[Bug] [Bug] sglang.bench_serving backend vllm error
#3848 opened Feb 25, 2025 by V-yw
4 of 5 tasks
@minleminzui
2
[Bug] output throughput reduce when batch>128
#3847 opened Feb 25, 2025 by Lzhang-hub
5 tasks
@minleminzui
[Feature] support arrch64 platform?
#3839 opened Feb 25, 2025 by bevis12
2 tasks
@minleminzui
1
[Bug] sglang crashes when running two deepseek-r1 instances
#3837 opened Feb 25, 2025 by echozyr2001
5 tasks done
@minleminzui
[Bug] Model Stuck at Prefill and then throw "Watchdog Timeout" Error After Idle Period (Deepseek-r1:671b on two H100*8)
#3836 opened Feb 25, 2025 by myoldcat
5 tasks done
@minleminzui
10
ProTip! Mix and match filters to narrow down what you’re looking for.