Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.
leaderboard transformer moe mixture-of-experts huggingface slerp large-language-models llm ties mergekit merge-llm dare-ties
-
Updated
Sep 18, 2025 - Jupyter Notebook