Tag: mixture-of-experts
All the articles with the tag "mixture-of-experts".
- AI Engineering
Google Made Qwen 397B Up to 4.7x Faster Without Training a New Model
Google's Ironwood optimization work shows how sharding, fused kernels, and memory-aware serving can change the economics of a frontier-scale open-weight model.