TechTowards Data Scienceabout 3 hours ago
Kimi K3 Report Details Frontier Model Build
1 min read
Moonshot's open Kimi K3 is a 2.8-trillion-parameter mixture-of-experts model with a 47-page technical report. Its Kimi Delta Attention uses a fixed-size state for linear scaling, enabling million-token contexts. The model reports a 2.5x scaling efficiency gain over Kimi K2, using roughly half the training compute.
Level
Hype check
Tap to vote and see what everyone thinks.
