In News:

Chinese AI startup Moonshot AI unveiled Kimi K3, the world's first open-source AI model in the 3-trillion-parameter class, marking a major advancement in open-source Artificial Intelligence.

About Kimi K3

• Kimi K3 is a multimodal, open-weight Large Language Model (LLM) designed for advanced reasoning, software engineering, coding, visual understanding, and enterprise applications.
• Developed by Moonshot AI, a Beijing-based AI startup backed by Alibaba, Tencent, and Meituan, it is among the largest open-source AI models released so far.
• The model adopts a Mixture-of-Experts (MoE) architecture, where only a small subset of experts is activated for each task, enabling high computational efficiency despite its enormous size.
• It also incorporates Kimi Delta Attention (KDA) and Attention Residuals (AttnRes) to improve long-context processing and multi-step reasoning.

Key Features

• One of Kimi K3's biggest strengths is its one-million-token context window, allowing it to process extensive documents, software repositories, or technical manuals in a single prompt.
• The model supports multimodal capabilities, combining text and image understanding for applications such as software development, computer-aided design (CAD), game development, and visual reasoning.
• It has also been released as an open-weight model, enabling researchers and developers worldwide to access, fine-tune, and self-host the model.