Skip to content

Commit

Permalink
post: update MoE rounting
Browse files Browse the repository at this point in the history
  • Loading branch information
p208p2002 authored May 17, 2024
1 parent b6c57bf commit 4a5b397
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion public/docs/moe-routing-design/document.md
Original file line number Diff line number Diff line change
Expand Up @@ -90,4 +90,3 @@ $$
$$

輔助損失函數的最小值會發生在每一位專家的 $f_i$ 和 $P_i$ 相等處,即 Token 被平均分配到每一位專家。
```

0 comments on commit 4a5b397

Please sign in to comment.