Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"
-
Updated
Apr 4, 2025 - Python
#
mixture-of-models
Here are 3 public repositories matching this topic...
The implementation of mixtures for different tasks.
linear-regression torch bayesian-methods ensemble ensemble-learning expectation-maximization-algorithm ensemble-prediction mixture-of-experts dirichlet-distributions mixture-of-models
-
Updated
Oct 17, 2024 - Python
🤪🧠💥 Mixture of Idiots (MoI): A Python project exploring 'Mixture of Models' (MOM) to solve complex problems by combining outputs from multiple LLMs (OpenAI, MistralAI, Gemini) using King, Duopoly, and Democracy architectures. Sometimes, a team of 'idiots' is surprisingly brilliant!
python ai openai problem-solving collective-intelligence api-integration mixture-of-models large-language-models llm google-gemini mistral-ai multi-model-systems king-architecture duopoly-architecture democracy-architecture
-
Updated
May 10, 2025 - Python
Improve this page
Add a description, image, and links to the mixture-of-models topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mixture-of-models topic, visit your repo's landing page and select "manage topics."