What Is Kimi K3? The 2.8T Open-Source Model and Launch Context
On the night of July 16, 2026, Moonshot AI posted a banner at the top of its API documentation — "🎉 Kimi K3 is live!" — with no keynote, no hype cycle, just a technical blog post, a pricing page, and an immediately callable model ID kimi-k3. The quiet launch contrasts sharply with a 2.8-trillion-parameter footprint.
One-line definition: Kimi K3 is currently the largest open-source AI model by parameter count — 2.8T parameters, roughly 75% larger than DeepSeek V4 Pro (1.6T), 2.7x Xiaomi's open model (1.02T), and more than 7x Alibaba (397B). It uses sparse MoE architecture, activating 16 of 896 experts at inference; paired with a 1-million-token context window (roughly five full copies of Dream of the Red Chamber) and native vision understanding, it targets complex coding, long-document reasoning, and knowledge work. Full weights open on July 27, at pricing roughly 40% below Claude Opus 4.8.
| Spec | Value |
|---|---|
| Total parameters | 2.8 trillion (2.8T) |
| Architecture | Kimi Delta Attention + Attention Residuals + Stable LatentMoE |
| Active experts | 16 / 896 (1.8% sparsity) |
| Context window | 1,048,576 tokens (1M) |
| Input modalities | Text, image, video |
| Reasoning mode | Max only today (low/high coming) |
| API pricing | $3 / $15 per 1M tokens (input/output) |
| Open weights | July 27, 2026 (Hugging Face) |
Why this launch matters: Moonshot AI spent the past 18 months under pressure from DeepSeek's rise. K3 is a sharp counterpunch:
Scale record: For 9 of the past 12 months, the Kimi family held the open-source scale ceiling.
Strategic timing: Launch landed the night before WAIC 2026 (World AI Conference) — a strong signal to the industry.
Commercial momentum: ARR passed $300M by June 2026; a sixth funding round closed this year at a $31.5B pre-money valuation.
API-driven growth: API revenue exceeds 70% of total; overseas paid users up 400% — not scale for scale's sake, but a commercially accelerating technical statement.
Selection mistakes to avoid: Do not equate "largest parameters" with "#1 on every benchmark"; do not ignore harness differences in self-reported scores; do not assume full local weights before 7/27; do not overlook Fable 5's FrontierSWE lead; do not route every agent workload to a single model.
Kimi Delta Attention and Three Architecture Innovations Explained
Kimi K3 is not simple parameter stacking — three engineering innovations address real bottlenecks in long context and ultra-sparse MoE training.
2.1 Kimi Delta Attention (KDA) — Hybrid Linear Attention
Standard full attention makes KV-cache memory grow quadratically with context — catastrophic at 1M tokens. KDA alternates linear and full attention layers in a 3:1 ratio: three linear layers handle local structure cheaply; one full attention layer preserves global information flow. Result: up to 75% less KV-cache memory; up to 6.3x faster decoding at million-token context; beats pure full-attention baselines on short context, long context, and RL scaling.
Analogy: full attention remembers every detail at once; KDA works like an efficient assistant — fast indexing most of the time, precise recall when it matters.
2.2 Attention Residuals (AttnRes) — Cross-Depth Selective Retrieval
Standard residual connections accumulate uniformly across depth — early-layer representations get diluted in deeper layers. AttnRes adds selective retrieval so the model can pull high-value representations from earlier layers directly across depth. Moonshot reports roughly 25% training efficiency gain with under 2% extra compute.
2.3 Stable LatentMoE — 896 Experts, 16 Active
| Technique | Role |
|---|---|
| Quantile Balancing | Derives expert allocation from router score quantiles, eliminating heuristic hyperparameters |
| Per-Head Muon | Per-attention-head optimization for more adaptive large-scale training |
| Sigmoid Tanh Unit (SiTU) | Improved activation control |
| Gated MLA | Sharper attention selectivity |
Combined, Kimi K3 delivers roughly 2.5x overall scaling efficiency vs Kimi K2 — same compute budget, stronger intelligence.
Kimi K3 Benchmarks: Full Comparison vs Claude Fable 5 and GPT-5.6 Sol
Core benchmarks below are Moonshot AI self-reported (different harness per model: K3 uses Kimi Code, GPT uses Codex, Claude uses Claude Code). Independent third-party reproduction is still in progress.
| Benchmark | Kimi K3 | Claude Fable 5 | GPT-5.6 Sol | Claude Opus 4.8 | GLM-5.2 |
|---|---|---|---|---|---|
| DeepSWE | 67.5 | 70.0 | 73.0 | 59.0 | 46.2 |
| Program Bench | 77.8 | 76.8 | 77.6 | 71.9 | 63.7 |
| Terminal Bench 2.1 | 88.3 | 84.6 | 88.8 | 84.6 | 82.7 |
| FrontierSWE | 81.2 | 86.6 | 71.3 | 66.7 | 67.3 |
| SWE Marathon | 42.0 | 35.0 | 39.0 | 40.0 | 13.0 |
| BrowseComp | 91.2 | 88.0 | 90.4 | 84.3 | — |
| Automation Bench | 30.8 | 29.1 | 29.7 | 27.2 | 12.9 |
| GPQA-Diamond | 93.5 | 92.6 | 94.1 | 91.0 | 91.2 |
| MMMU-Pro (vision) | 81.6 | 81.2 | 83.0 | 78.9 | — |
| OmniDocBench (document understanding) | 91.1 | 89.8 | 85.8 | 87.9 | — |
Key takeaways:
SWE Marathon (42.0, #1): Tests sustained long coding sessions — closest to "writing code for hours" — where K3 leads decisively.
Program Bench (77.8, #1): Edges Fable 5 (76.8) and GPT-5.6 Sol (77.6) by a narrow margin.
FrontierSWE: Fable 5 leads at 86.6; K3 (81.2) still well ahead of GPT-5.6 Sol (71.3).
OmniDocBench (91.1, #1): Shows vision + long-context synergy.
Overall intelligence: Artificial Analysis Intelligence Index v4.1 ranks K3 57.1, fourth overall — behind Fable 5 (59.9) and GPT-5.6 Sol (58.9) by just 2.8 points.
Note: Vendor self-reported data with non-unified harnesses. Treat as directionally useful, not definitive — validate on your own eval sets before production selection.
Kimi K3 Pricing Comparison and Six Ways to Start Using It Today
| Model | Input ($/M) | Output ($/M) | Cached input | Context |
|---|---|---|---|---|
| Kimi K3 | $3.00 | $15.00 | $0.30 | 1M |
| Claude Sonnet 5 | $3.00 (promo $2) | $15.00 (promo $10) | — | 200K |
| Claude Opus 4.8 | $5.00 | $25.00 | — | 200K |
| GPT-5.5 | $5.00 | $30.00 | — | 400K |
| DeepSeek V4 Pro | $1.74 | $3.48 | $0.145 | 128K |
| Kimi K2.6 | $0.95 | $4.00 | $0.16 | 256K |
K3 standard pricing matches Claude Sonnet 5 ($3/$15) but with a context window 5x larger. Cached input drops to $0.30/M (one-tenth of standard); Moonshot reports over 90% cache hit rates in coding workflows, making effective input cost very low. China API: ¥20/M input, ¥100/M output, ¥2/M cached; consumer kimi.com free tier available; prepaid plans from ¥199 (promo through August 11).
Six steps to start using Kimi K3 today:
Kimi web/app: Visit kimi.com, register (Google sign-in supported). K3 runs at max reasoning by default — no credit card required.
Official API key: Create a key at platform.kimi.ai, set base_url to https://api.moonshot.ai/v1, model ID kimi-k3.
OpenRouter routing: Model ID moonshotai/kimi-k3 — official pricing, no markup, full 1M context.
Cache optimization: Reuse system prompts and tool-definition prefixes in coding agent workflows; Mooncake disaggregated inference can hit 90%+ cache hit rates.
July 27 weights: Full model weights on Hugging Face require a 64+ accelerator supernode; MXFP4/NVFP4 quantized builds with Day-0 vLLM and SGLang support expected.
Mixed routing: Route long coding tasks to K3, complex repo-level bugs to Fable 5, terminal-heavy agents to GPT-5.6 Sol — do not all-in on one model.
from openai import OpenAI
client = OpenAI(
api_key="your_moonshot_api_key",
base_url="https://api.moonshot.ai/v1"
)
response = client.chat.completions.create(
model="kimi-k3",
messages=[{"role": "user", "content": "Analyze this code for me..."}]
)Scenario Matrix, Open-Source Commitment, and Citeable Data
| Scenario | Recommended model | Why |
|---|---|---|
| Sustained long coding tasks | Kimi K3 | SWE Marathon #1, longest context |
| Complex repo-level bug fixes | Claude Fable 5 | FrontierSWE lead by a wide margin |
| Terminal / toolchain-heavy agents | GPT-5.6 Sol | Terminal Bench and Coding Agent Index lead |
| Ultra-long docs / multimodal document understanding | Kimi K3 | OmniDocBench #1, native vision + 1M context |
| Cost-sensitive workloads | DeepSeek V4 Pro | Output at $3.48/M, far below K3 |
| Self-hosted open weights (post 7/27) | Kimi K3 | Strongest downloadable open weights to date |
July 27 open-source commitment: Moonshot's official WeChat announcement confirms full model weights release on July 27. K3 will become: the largest downloadable open model to date; the first open weights above 2T parameters; a new fine-tuning baseline for the open community. Training uses MXFP4 weights and MXFP8 activations with quantization-aware design; MXFP4/NVFP4 builds expected on Hugging Face.
2.8T / 75%: Nearly 75% larger than DeepSeek V4 Pro (1.6T) — a new global open-source scale record.
57.1 / 2.8: Artificial Analysis v4.1 ranks K3 fourth overall, just 2.8 points behind leader Fable 5 (59.9).
$0.30 / 90%+: Cached input pricing plus 90%+ cache hit rates in coding — effective input cost can drop to roughly $0.55/M (OpenRouter 7-day weighted validation).
Summary: Kimi K3 delivers genuine engineering innovation at the architecture level, matching or beating closed-source flagships on key tracks like long coding tasks and document understanding, with fair pricing and a full open-weight promise — signaling China's open AI ecosystem moving from "price to win" toward "challenge the frontier." Key dates: WAIC releases July 17–20 → July 27 K3 full weight release.
Lay out the alternatives: running Kimi Code / API agents on a personal Mac suffers sleep and network interruptions on long-context jobs; waiting for 7/27 self-hosting requires a 64+ card supernode — not viable for most teams short term; relying on a single closed API misses K3's 1M flat-pricing advantage on context length and cost. For iOS CI/CD, persistent Kimi Code, and 24/7 AI agent production, KVMNODE dedicated Mac Mini M4 cloud rental is usually the better host: Apple Silicon unified memory, open sudo, flexible daily/weekly/monthly terms. See the pricing page, help center, or order directly.
Data as of: July 16, 2026 · Benchmarks are Moonshot AI self-reported · Sources: kimi.com/blog/kimi-k3, API Platform docs, Artificial Analysis, OpenRouter