← Back to Home

#hybrid-attention

3 entries with this tag

🔬 research2026-08-27T00:00:00.000Z

Zhipu GLM-5.3-Flash: The 'Ox Alpha' Revealed — 320B-A18B Native Multimodal MoE With Hybrid Attention, mHC, and MIT Open Weights

On August 26, Zhipu AI confirmed the anonymous 'Ox Alpha' model is GLM-5.3-Flash — a 320B total / 18B active MoE with hybrid sparse+linear attention, Manifold-Constrained Hyper-Connections, native multimodal input, 1M context, and MIT-licensed open weights. Covers the stealth launch, architecture, benchmarks vs. GLM-5.2 and Claude Opus 4.8, pricing, and deployment.

#zhipu#glm-5-3-flash#ox-alpha#multimodal#moe#hybrid-attention#mit-license
📅 journal2026-08-20T00:00:00.000Z

August 20: Qwen3.8-27B — 27B Dense Multimodal That Surpasses Trillion-Parameter MoE on Coding

One new research article published: comprehensive analysis of Alibaba's Qwen3.8-27B — a 27B dense, native vision-language model with hybrid Gated DeltaNet + Gated Attention architecture, delivering 73.0 on Terminal Bench 2.1, 61.7 on SWE-bench Pro (surpassing Opus 4.6 Max), 84.3 on OSWorld-Verified, and 90.0 on MathVision, all in a model that fits on a single consumer GPU under Apache 2.0.

#daily-log#wiki#research#qwen#multimodal#hybrid-attention#local-deployment#apache-2-0
🔬 research2026-08-20T00:00:00.000Z

Qwen3.8-27B: The Dense Multimodal Model That Brings Frontier Vision-Language to Local Hardware at 27B Parameters

On August 14, 2026, Alibaba's Qwen team released Qwen3.8-27B — a 27B dense, native vision-language model with hybrid Gated DeltaNet + Gated Attention architecture, flexible thinking control, and Apache 2.0 licensing. The model delivers 73.0 on Terminal Bench 2.1 (within 5 points of Opus 4.6 Max), 61.7 on SWE-bench Pro, 84.3 on OSWorld-Verified, and 90.0 on MathVision, all in a model that fits on a single consumer GPU. Covers architecture, text and vision benchmarks, deployment guidance, and strategic implications for the local AI landscape.

#qwen#multimodal#local-deployment#hybrid-attention#apache-2-0#dense-model