Skip to content

fix(gemma3): use GeGLU activation instead of SwiGLU#1825

Open
leofan-lab wants to merge 2 commits intoTHUDM:mainfrom
leofan-lab:fix/gemma3-activation-geglu
Open

fix(gemma3): use GeGLU activation instead of SwiGLU#1825
leofan-lab wants to merge 2 commits intoTHUDM:mainfrom
leofan-lab:fix/gemma3-activation-geglu

Commits

Commits on Apr 10, 2026