GO TO A SECTION

↑ ↓ to navigate · Enter to openExplore all sections →
FDEInterviews logo
arXiv preprint

Kimi K2: Open Agentic Intelligence

Read Kimi K2 through its sparse architecture, stateful tool-data pipeline and benchmark harnesses, with capacity arithmetic and a runnable simulator exercise.

Breakdown by FDE Interviews · 10 min read · Updated

About the original · 2025
AUTHORS
Kimi Team
FROM
Moonshot AI
PUBLISHED
Jul 2025 · arXiv preprint
IN THIS BREAKDOWN · 10 SECTIONS

You can read 17% of this breakdown.

01

The paper in one minute

Kimi K2 is a large mixture-of-experts model whose report connects training infrastructure with tool-use behavior. The architecture has substantially more stored parameters than it activates for a token. Post-training then teaches the model to operate tools through generated trajectories, stateful simulation, real execution environments and outcome feedback.

The report introduces MuonClip to control attention-logit growth during pretraining. Its agentic data pipeline constructs tool specifications, creates agents and tasks, simulates multi-turn interactions and filters trajectories against task rubrics. Real coding environments complement simulation where executable feedback is especially valuable.

For an FDE, the strongest lessons are architectural and experimental. Active parameter count is not the memory footprint of the full checkpoint. A benchmark score belongs to a model plus a harness, tools and attempt budget. A simulator must preserve state consistently if its trajectories are to teach useful behavior.

This breakdown reviews the K2 report, including its February 2026 revision, as a historical research artifact. It does not claim that the original checkpoint is the best current model for a new deployment. Use the official model repository to identify the exact artifact, then evaluate that artifact against the customer's requirements rather than inheriting a leaderboard conclusion.

THE IDEA, VISUALLY
A TOOL TRAJECTORY NEEDS CONSISTENT STATE A plausible success message is not enough. Validate each transition and the final state. 0 2 5 Available units 5 Start 2 Reserve 3 2 Reserve 3 5 Cancel first 5 Cancel again Rejected: only 2 remain Our executed toy simulator illustrates section 3.1.1; it is not a K2 benchmark or a production inventory system.
Our executed synthetic inventory trajectory illustrates the stateful simulator described in section 3.1.1. Its quantities and actions are invented. The point is to verify transitions and terminal state rather than accepting a fluent success message.
Research notes: the problem, approach and results
1.04T

total parameters, Table 2

32.6B

activated parameters, Table 2

65.8%

SWE-bench Verified, agentic single attempt, Table 3

THE PROBLEM

A model needs useful tool trajectories and outcome feedback, while a sparse architecture creates its own infrastructure requirements.

THE IDEA

Combine large-scale MoE pretraining with simulated and real tool environments, filtered demonstrations and joint reinforcement learning.

THE RESULT

The report shows strong historical agentic results under specific harnesses; deployment still requires full-weight capacity planning and independent action controls.

02

Why it matters to an FDE

A sparse model can look deceptively inexpensive if a proposal quotes only activated parameters. The experts still need storage, placement and communication, while long contexts add cache and runtime memory. Capacity planning should begin with the full checkpoint and the serving implementation, not a comparison with a dense model of similar active size.

The tool-training pipeline offers a second practical lesson. You can generate many plausible conversations cheaply, but an impossible state transition makes the resulting demonstration misleading. A useful agent gym needs action contracts, environment state and outcome checks before it needs a larger collection of fluent transcripts.

Finally, compare complete systems. Changing the patch-selection strategy or allowing additional attempts can improve a software-engineering score without changing the model weights. Record those choices in enterprise model selection, along with resource cost and the customer's actual completion criteria.

THE FULL BREAKDOWN

Understand the mechanism. Try it on a real problem.

Unlock this breakdown and 199 more papers.

Premium opens every paper in full, plus every answer, concept, course and guide on the site. One payment for six months of access.

6 months · One payment · No auto-renewal

Get Premium · ₹2,000 / $25
  • ◇1 architecture diagram
  • </>2 runnable code blocks
  • ▦3 results tables
  1. 03Key takeaways

    Six distinctions that prevent sparse-model and agent-benchmark claims from being overstated

    Free account
  2. 04How it works

    Connect sparse pretraining to tool demonstrations and outcome-driven post-training

    Premium
  3. 05The numbers that matter

    Keep precise architecture counts and attempt budgets attached to the reported results

    Premium
  4. 06Try it yourself

    Calculate raw weight capacity and test a tiny stateful tool environment

    Premium
  5. 07Where it breaks

    Recognize simulator shortcuts, self-judge errors and misleading sparse-capacity estimates

    Premium
  6. 08Using it on a deployment

    Evaluate a checkpoint and borrow the environment discipline without reproducing pretraining

    Premium
  7. 09Interview angles

    Explain active versus stored parameters and why a successful transcript is insufficient

    Premium
Back to the paper library →