Mixture of experts

lastmod 2026-03-24created 2025-10-022 edits

Mixture of experts is a machine learning technique that uses multiple expert networks to divide a problem space into homogeneous regions. MoE represents a form of ensemble learning.

See also

• Korean: 추천 시스템
• Moondream
• Flash-MoE - Runs a 397-billion-parameter model on a laptop

Favorite site

• Mixture of experts - Wikipedia
• Overview of Mixture-of-Experts recommender systems - ①
• MoE: Mixture of Experts - Artificial Intelligence (AI) & Machine Learning (ML) Dictionary
• Applying Mixture of Experts (MoE) in LLM Architectures - NVIDIA Technical Blog