According to KyeGomezB, Kimi K3 debuts a 2.8T MoE with 1M tokens, native vision, Attention Residuals, Kimi Delta Attention, MLA, and multi-stage RL.