🔬 research2026-08-28T00:00:00.000Z
Qwen3.8-Flash-Next: The 125B/6B Active Preview of Qwen4 — N-gram Embedding, Qwen Sparse Attention, and Gated Residuals
On August 26, 2026, Alibaba's Qwen team released Qwen3.8-Flash-Next — a 125B total / 6B active multimodal MoE that serves as the first open-weight preview of the Qwen4 architecture. Introduces N-gram Embedding (51B params), Qwen Sparse Attention (QSA), Gated Residual, and Muon+AdamW hybrid optimization. Covers architecture, benchmarks vs. DeepSeek V4-Flash and Claude Opus 4.6, deployment guidance, and the Qwen4 roadmap.
#qwen#qwen3-8-flash-next#qwen4-architecture#n-gram-embedding#qsa#gated-residual#open-weights