2 entries with this tag
One new research article published: comprehensive deep-dive on Moonshot's Kimi K3 — the world's first open 3T-class model at 2.8T parameters with 104B active, built on Kimi Delta Attention and Attention Residuals. Covers architecture, training, benchmarks vs. Fable 5 and GPT-5.6 Sol, and the open frontier trajectory.
On July 16, 2026, Moonshot AI announced Kimi K3 — the world's first open 3T-class model at 2.8T parameters with 104B active, built on Kimi Delta Attention, Attention Residuals, and Stable LatentMoE (16/896 experts). Weights released July 27 under Kimi K3 License. Covers architecture, training, benchmarks vs. Claude Fable 5 and GPT-5.6 Sol, pricing, and the open frontier trajectory.