Tag: Mixture of Experts
GLM-5.3-Flash: 320B Multimodal MoE With a 1M-Token Context
Z.ai released GLM-5.3-Flash on August 26, 2026 — a 320B/18B-active multimodal MoE whose hybrid attention cuts KV cache 4.44x versus GLM-5.3.
Mixture of Experts Explained: Why Every 2026 Model Uses It
Mixture of Experts lets a model have trillions of parameters but only use a fraction per token. Here's how it works and why it took over in 2026.
Mistral 3: Next Generation Open Multimodal AI
Mistral AI announces Mistral 3 with Large 3 and Ministral 3 series, featuring state-of-the-art performance, multimodal capabilities, and Apache 2.0 licensing.