Moonshot AI Releases Kimi K3: A 2.8 Trillion Parameter Open MoE Model With Kimi Delta Attention and 1M Context
Moonshot AI simply launched Kimi K3. It is a 2.8-trillion-parameter mannequin with native imaginative and prescient and a 1-million-token context window. Moonshot calls it the world’s first open 3T-class mannequin. What is Kimi K3? Kimi K3 is a sparse Mixture-of-Experts (MoE) mannequin constructed on two architectural updates. Those are Kimi Delta Attention (KDA) and Attention…
