Swap xeon ci to gnr #19

DiweiSun · 2025-08-01T07:56:37Z

Motivation

Modifications

Accuracy Test

Benchmark & Profiling

Checklist

Format your code according to the Code Formatting with Pre-Commit.
Add unit tests as outlined in the Running Unit Tests.
Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.

…-project#8515)

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com> Co-authored-by: nnnobody-code <nnnobody@foxmail.com> Co-authored-by: ispobock <ispobaoke@gmail.com> Co-authored-by: Qiaolin-Yu <qy254@cornell.edu> Co-authored-by: Qiaolin-Yu <liin1211@outlook.com> Co-authored-by: Xinyuan Tong <justinning0323@outlook.com> Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

…age (sgl-project#8595) Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

…e DCA's kernel for bugfix. (sgl-project#8611) Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com> Co-authored-by: sa-buc <linzhu.ht@w32d09270.cloud.sqa.na131>

…d up by up to 3x (sgl-project#8577)

Signed-off-by: windsonsea <haifeng.yao@daocloud.io>

Signed-off-by: Vishwanath Venkatesan <vvenkatesan@nvidia.com> Co-authored-by: Moein Khazraee <moein@nvidia.com> Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

…ect#8634)

…t#8630)

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

…gl-project#8632) Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>

…8532)" (sgl-project#8642)

Co-authored-by: ronnie_zheng <zl19940307@163.com>

Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com> Co-authored-by: ronnie_zheng <zl19940307@163.com>

Co-authored-by: ronnie_zheng <zl19940307@163.com>

…-project#8450) Co-authored-by: kushanam <42385577+kushanam@users.noreply.github.com>

… deepgemm in EpMoE (sgl-project#8955)

Signed-off-by: ybyang <ybyang7@iflytek.com> Signed-off-by: huanglong <huanglong@linux.alibaba.com> Co-authored-by: lw9527 <952799980@qq.com> Co-authored-by: huanglong <huanglong@linux.alibaba.com> Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>

…#8757)

Co-authored-by: HAI <hixiao@gmail.com>

…ng (sgl-project#8972)

Signed-off-by: Tony Lu <tonyluj@gmail.com>

…ect#8772)

…low (sgl-project#8981)

…8982)

… different storage (sgl-project#8785)

Co-authored-by: Suruchi Shah <surshah@linkedin.com>

…_gate (select_experts) (sgl-project#8770)

Co-authored-by: Yineng Zhang <me@zhyncs.com>

…ic adjustments (sgl-project#8983)

ch-wan and others added 30 commits July 31, 2025 00:14

update sgl-kernel for EP: python part (sgl-project#8550)

e179e0b

add SVG logo (sgl-project#8603)

e7dc163

[4/N] MoE Refactor: Unified Triton Kernel for FusedMoE and EPMoE (sgl…

32fa1e9

…-project#8515)

fix: fork should not run pypi router (sgl-project#8604)

09f1a24

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

[Feature] Hybrid EP and TP (sgl-project#8590)

7a1f7fc

chore: bump v0.4.10 (sgl-project#8608)

0232886

[PD] Use batch transfer for rdma transport and add notes for mnnvl us…

016fd25

…age (sgl-project#8595) Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

[bugifx] QWen-1M context support[2/3] using current cuda stream in th…

5d15fb8

…e DCA's kernel for bugfix. (sgl-project#8611) Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com> Co-authored-by: sa-buc <linzhu.ht@w32d09270.cloud.sqa.na131>

Fix hf3fs_fuse import error (sgl-project#8623)

3c307dc

Update step3v default config (sgl-project#8626)

8fbcfd0

[ci] fix genai-bench execution cmd (sgl-project#8629)

ae80777

[router] update router pypi version (sgl-project#8628)

aee0ef5

[Optimization][Perf] Disable the GC during CUDA graph capture to spee…

4acf690

…d up by up to 3x (sgl-project#8577)

Fix typos in py_test/test_launch_server.py (sgl-project#6227)

061c895

Signed-off-by: windsonsea <haifeng.yao@daocloud.io>

misc: Remove debug print to logger.info (sgl-project#8633)

743638b

SGLang HiCache NIXL Connector (sgl-project#8488)

2cd2e27

Signed-off-by: Vishwanath Venkatesan <vvenkatesan@nvidia.com> Co-authored-by: Moein Khazraee <moein@nvidia.com> Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

[bug] remove pdlb from minilb since its no longer available (sgl-proj…

5c14515

…ect#8634)

[bugfix] Fix flashinfer cutlass EP moe after MoE refactor (sgl-projec…

b7170cc

…t#8630)

Conditionally import HiCacheHF3FS (sgl-project#8598)

3dde861

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

TRTLLM Gen MLA Decode Kernel Integration (same as sgl-project#7938) (s…

4b04998

…gl-project#8632) Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>

Fix nan value generated after custom all reduce (sgl-project#8532)

4a6e7a6

Revert "Fix nan value generated after custom all reduce (sgl-project#…

0ad098b

…8532)" (sgl-project#8642)

Feature/modelscope model download (sgl-project#8083)

0491343

Co-authored-by: ronnie_zheng <zl19940307@163.com>

chore: speedup NPU CI by cache (sgl-project#8270)

fe5086f

Signed-off-by: mywaaagh_admin <pkwarcraft@gmail.com> Co-authored-by: ronnie_zheng <zl19940307@163.com>

[Bugfix] fix w8a8_int8 load issue (sgl-project#8308)

99795d6

Co-authored-by: ronnie_zheng <zl19940307@163.com>

[bugfix] fix router python parser for pd urls (sgl-project#8644)

2886e23

[router] add basic usage doc (sgl-project#8640)

f6f46f4

[router] upgrade router version to 0.1.8 (sgl-project#8645)

39decec

[NVIDIA] Enable Flashinfer MoE blockscale fp8 backend for TP MoE (sgl…

aa4c66b

…-project#8450) Co-authored-by: kushanam <42385577+kushanam@users.noreply.github.com>

ch-wan and others added 30 commits August 8, 2025 00:46

Expert Parallelism for GPT-OSS (sgl-project#8944)

1d24db8

Add ernie4.py for ERNIE-4.5 (sgl-project#7657)

1132547

[NVIDIA] Fix missing get_col_major_tma_aligned_tensor for Blackwell…

b4c9f38

… deepgemm in EpMoE (sgl-project#8955)

chore: bump sgl-kernel v0.3.3 (sgl-project#8957)

54ea57f

add zai-org/GLM-4.5-Air-FP8 model into nightly CI (sgl-project#8894)

6ee6619

Simple prefetch policy (sgl-project#8692)

e2fd2b9

chore: update flashinfer (sgl-project#8958)

41357e5

Revert "Support Multi Process Tokenizer Manager" (sgl-project#8960)

a947154

[RL] fix skip_server_warmup and rl health_generate logic (sgl-project…

dd650e0

…#8757)

chore: bump v0.5.0rc0 (sgl-project#8959)

9020f7f

[router] router circuit breaker core (sgl-project#8941)

61a4680

refine aiter_backend for mtp (sgl-project#7279)

53f7874

Co-authored-by: HAI <hixiao@gmail.com>

[router] harden retries + metrics; fix streaming load; header filteri…

a59cbea

…ng (sgl-project#8972)

Fix kimi k2 function call format (sgl-project#8968)

91e2f90

[router] add metrics for worker and policy (sgl-project#8971)

36bfdde

Signed-off-by: Tony Lu <tonyluj@gmail.com>

chore(gb200): update to CUDA 12.9 and improve build process (sgl-proj…

4e7f025

…ect#8772)

chore(ci): update Python version from 3.9 to 3.10 in sgl-kernel workf…

7d3af60

…low (sgl-project#8981)

[router] reduce contention, fix double-count race (sgl-project#8978)

1a8706c

[router] fix radix tree integration issues in PD router (sgl-project#…

7b7e561

…8982)

Update qwen3_coder_detector.py for streaming (sgl-project#8371)

b3359dc

[bug fix] Ensure local token and global token buffers are pointing to…

92cbef5

… different storage (sgl-project#8785)

Create cancel-all-pr-test-runs (sgl-project#8986)

67a7d1f

[Fix] Add a workflow to cancel all pending CI runs (sgl-project#8988)

6642e3a

Minor Optimizations in Schedule Batch (sgl-project#8724)

f352b79

Co-authored-by: Suruchi Shah <surshah@linkedin.com>

[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into moe_fused…

591c232

…_gate (select_experts) (sgl-project#8770)

Add unit test for flashinfer fp4 moe (sgl-project#8330)

a60f88b

Co-authored-by: Yineng Zhang <me@zhyncs.com>

[AMD] Update SGLang image fallback logic for AMD CI (sgl-project#8980)

23f2afb

Clean up server_args.py to have a dedicated function for model specif…

706bd69

…ic adjustments (sgl-project#8983)

Merge branch 'main' into molly/ci_gnr_server

288cc77

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Swap xeon ci to gnr #19

Swap xeon ci to gnr #19

Uh oh!

DiweiSun commented Aug 1, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Swap xeon ci to gnr #19

Are you sure you want to change the base?

Swap xeon ci to gnr #19

Uh oh!

Conversation

DiweiSun commented Aug 1, 2025

Motivation

Modifications

Accuracy Test

Benchmark & Profiling

Checklist

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants