Code

Deepseek v3 dev#422

Code

Closed

rasmith wants to merge 16 commits intomainROCm/vllm:mainfrom deepseek_v3_devROCm/vllm:deepseek_v3_devCopy head branch name to clipboard

+7,905-34

Commits

Commits on Feb 5, 2025

• fused_moe config for DSv3 on MI300X updated

  qli88

  committed
  50cfad1

  Copy full SHA for 50cfad1

• Add tuning script and post processing script

  Show description for bb0275b
  rasmith

  committed
  bb0275b

  Copy full SHA for bb0275b

• Add modification to fp8_utils for tuning

  Show description for 2f072c5
  rasmith

  committed
  2f072c5

  Copy full SHA for 2f072c5

• update tuning script and add the configs

  Show description for 2e45ba4
  rasmith

  committed
  2e45ba4

  Copy full SHA for 2e45ba4

Commits on Feb 6, 2025

• slightly better tunings

  Show description for 83fe307
  rasmith

  committed
  83fe307

  Copy full SHA for 83fe307

• benchmark_moe.py is updated to generate more accurate MoE configs and a specific MoE config for DSv3 is added

  qli88

  committed
  b471264

  Copy full SHA for b471264

• Bug in sgl_moe_align_block_size() is fixed by Greg

  qli88

  committed
  f1aa6a8

  Copy full SHA for f1aa6a8

• Generate fp8_w8a8 config for MI300XHF

  qli88

  committed
  b7e4e98

  Copy full SHA for b7e4e98

• tunings that don't give garbage output

  Show description for d4a29be
  rasmith

  committed
  d4a29be

  Copy full SHA for d4a29be

• Merge branch 'deepseek_v3_dev' of github.com:ROCm/vllm into deepseek_v3_dev

  rasmith

  committed
  fdaef9b

  Copy full SHA for fdaef9b

• More accurate tunings

  Show description for 85e4148
  rasmith

  committed
  85e4148

  Copy full SHA for 85e4148

Commits on Feb 7, 2025

• More accurate tunings and reject inaccurate configs

  Show description for 0fc8b54
  rasmith

  committed
  0fc8b54

  Copy full SHA for 0fc8b54

Commits on Feb 11, 2025

• add new tunings

  Show description for 0818d59
  rasmith

  committed
  0818d59

  Copy full SHA for 0818d59

Commits on Feb 12, 2025

• rename tuning script and add benchmark script to use for optimizing blockwise quant

  Show description for 8e40097
  rasmith

  committed
  8e40097

  Copy full SHA for 8e40097

• Merge branch 'main' into deepseek_v3_dev

  gshtras

  authored
  f2f0582

  Copy full SHA for f2f0582

Commits on Feb 13, 2025

• yapf

  Show description for f77087d
  rasmith

  committed
  f77087d

  Copy full SHA for f77087d