Tag: llm-inference
All the articles with the tag "llm-inference".
- AI Engineering
Google Made Qwen 397B Up to 4.7x Faster Without Training a New Model
Google's Ironwood optimization work shows how sharding, fused kernels, and memory-aware serving can change the economics of a frontier-scale open-weight model.