Moonshot AI · 2.8T MoE · Weights out July 27, 2026 · K3.1 Pro weights due Nov 4
Kimi K3 & K3.1: Release Date, Weights and Local Specs
Kimi K3 was announced on July 16, 2026 and its weights went up on Hugging Face on July 27: a 2.8-trillion-parameter Mixture-of-Experts model with 104B active parameters, a 1M-token context and 1.56 TB of MXFP4 weights. Its successor, Kimi K3.1 Pro, rolled out through Moonshot's apps and API on October 23, 2026, with weights promised by November 4. You can download K3, but the smallest community GGUF is 466 GB, so running it locally means a machine with around half a terabyte of memory or more.
Status — as of November 2, 2026
Kimi K3: open weights on Hugging Face under the Kimi K3 License; GGUFs from Unsloth (466 GB to 1,561 GB) that need Unsloth's llama.cpp fork; NVFP4 build from NVIDIA; on Ollama only as the cloud-hosted kimi-k3:cloud, with no local Ollama tag. Kimi K3.1 Pro: API and apps since October 23; weights due by November 4, 2026. We will update this page when they land.
Key takeaways
- →2.8T total, 104B active — 16 of 896 experts plus 2 shared per token. Roughly 2.7x the 1.03T Kimi K2.6 and K2.7-Code.
- →1.56 TB at native 4-bit (MXFP4) — trained quantisation-aware, so the release is already 4-bit. The smallest GGUF is 466 GB (1-bit); 2-bit starts at 711 GB.
- →K3.1 Pro: October 23, 2026 on the API and apps; open weights due by November 4, with cyber-related training data removed from the open release.
- →Licence: Kimi K3 License — MIT-style, with an extra agreement needed only for model-as-a-service businesses above US$20M revenue.
- →Want something you can run? The Kimi K2 line from about 304 GB, or GLM-5.2 and other models in the free local AI models guide.
Quick answer
If you came here to find out which GPU runs Kimi K3: none on its own. Even the most aggressive GGUF, Unsloth's 466 GB UD-Q1_0, is larger than any single card or most workstations. K3 is built for multi-GPU servers; Moonshot's model card recommends vLLM, SGLang or TokenSpeed to serve it, and the 1.56 TB official weights are already 4-bit, so there is no 8-bit-to-4-bit saving left to take.
The practical playbook: use the K3 or K3.1 API if you want the model, and self-host from the tier below it. The Kimi K2 line is the runnable branch of the family, and GLM-5.2 is a frontier-class open model that is far more practical to self-host.
Kimi K3.1 Pro: release date and weights
Kimi K3.1 Pro rolled out on October 23, 2026, according to Moonshot's launch post, on Kimi.com, the mobile apps, Kimi Work, Kimi Code and the Kimi API, with a 1-million-token context. Moonshot calls it its most capable “3T-class open-weight” model and says the full weights are due by November 4, 2026.
One detail matters for anyone planning to self-host: Moonshot says it identified and removed cyber-related data from both training stages of the open-weight release, and reports its internal offensive-security test score dropping as a result. The open K3.1 weights will therefore not be identical in behaviour to the API model.
Moonshot has not published a parameter count for K3.1 Pro beyond “3T-class”, so plan on hardware at least as large as K3's until the files are on Hugging Face and their size is known.
Kimi K3 specs at a glance
| Vendor | Moonshot AI |
| Launched | July 16, 2026 (API/app); weights on Hugging Face July 27, 2026 |
| Architecture | Mixture-of-Experts — 16 of 896 routed experts plus 2 shared per token |
| Total / active parameters | 2.8 trillion / 104 billion |
| Layers | 93: 69 Kimi Delta Attention (KDA) + 24 gated MLA; hidden size 7,168 |
| Context window | 1,048,576 tokens |
| Vision | Native: MoonViT-V2 encoder (401M parameters), text + image input |
| Native weight format | MXFP4 weights / MXFP8 activations, quantisation-aware training |
| Weight size | 1.56 TB (Hugging Face repo) |
| License | Kimi K3 License (MIT-style with commercial conditions) |
| Local runtimes | Unsloth GGUFs via Unsloth's llama.cpp fork; no local Ollama tag (only kimi-k3:cloud) |
| Recommended serving | vLLM, SGLang, TokenSpeed on multi-GPU servers |
Source: the moonshotai/Kimi-K3 model card. One naming note: you'll occasionally see this model called "Kimi V3." There is no Kimi V3 — the real name is K3, the successor to the K2 line.
Release date & license
K3 launched July 16, 2026 through Moonshot's API and app — see Moonshot's official Kimi K3 announcement. Moonshot had promised open weights by July 27, and kept the date: the full weights, the technical report and a KDA prefix-caching implementation for vLLM were published that day.
The licence turned out to be its own text, the Kimi K3 License, rather than the modified MIT of the K2 line. It grants the usual MIT rights, then adds two conditions: a company running a model-as-a-service business with more than US$20 million revenue over 12 months must sign a separate agreement before commercial use, and products with more than 100 million monthly users or US$20 million monthly revenue must display “Kimi K3”. Internal use is exempt from both.
The vLLM integration means multi-node operators had a serving path on day one. KDA is a new attention design, so llama.cpp support arrived through Unsloth's fork rather than a release of mainline llama.cpp, and Ollama offers K3 only as a cloud model.
Can you run it locally? Only on very big iron
The arithmetic, with real file sizes now that the weights are out:
The weights are already 4-bit
K3's native format is MXFP4. With most models, "just quantize it to 4-bit" cuts the size roughly 4×. K3 starts there — 1.56 TB at native 4-bit — so the usual escape hatch is gone before you open it. Unsloth's own 4-bit GGUF is 1,509 GB, barely smaller.
The 2-bit and 1-bit files are still enormous
Unsloth's 2-bit files are 711 GB (UD-IQ2_XXS) and 861 GB (UD-Q2_K_XL); the 1-bit UD-Q1_0 is 466 GB. A 512 GB Mac Studio is the only single consumer machine near the smallest one, and with macOS keeping part of unified memory for itself, there is almost no room left for context.
Moonshot's guidance is server-class
The model card lists vLLM, SGLang and TokenSpeed as the recommended engines, all aimed at multi-GPU servers with tensor and expert parallelism. Not an 8 GB gaming card, not a single workstation GPU.
No speed figure here, on purpose
Mixture-of-experts speed depends on which experts each token touches and where they sit (VRAM, RAM or disk), so the simple bandwidth ceiling this site uses for dense models does not apply. Any page quoting a K3 tokens-per-second figure for a home machine without saying how it was measured is guessing.
Kimi K3 GGUF sizes and the hardware they need
Sizes from unsloth/Kimi-K3-GGUF (total of the split files). You need at least the file size in combined RAM and VRAM, plus room for the context cache.
| Build | Size | Note |
|---|---|---|
UD-Q1_0 | 466 GB | Smallest file; only a 512 GB machine comes close |
UD-TQ1_0 | 509 GB | |
UD-IQ1_S | 594 GB | |
UD-IQ2_XXS | 711 GB | Smallest 2-bit |
UD-Q2_K_XL | 861 GB | 1 TB RAM server, or RAM + several GPUs |
UD-Q4_K_XL | 1,509 GB | Close to the original MXFP4 size |
UD-Q8_K_XL | 1,561 GB | Lossless relative to the MXFP4 release |
Official MXFP4 (safetensors) | 1,561 GB | For vLLM / SGLang on multi-GPU servers |
Unsloth's README says to run these with its llama.cpp PR fork or Unsloth Studio. NVIDIA publishes nvidia/Kimi-K3-NVFP4 for Blackwell-class servers.
API pricing
For most people the API is the practical way to use K3. Launch pricing (July 2026), flat across all context lengths:
| Metric | Kimi K3 (launch) | Kimi K3.1 Pro (Vals AI listing) |
|---|---|---|
| Input (cache miss) | $3.00 / MTok | $2.00 / MTok |
| Input (cache hit) | $0.30 / MTok | not listed |
| Output | $15.00 / MTok | $10.00 / MTok |
At launch Moonshot reported over 90% cache hits on coding workloads, which would put most input at the $0.30 rate. Output is where K3 was premium-priced; for comparison, DeepSeek V4 lists far cheaper output. Check Moonshot's platform for current prices.
Benchmarks — Moonshot's claims, labeled as such
The model card's evaluation tables are Moonshot's own runs, mostly with its Kimi Code harness, mixed with scores it cites from Artificial Analysis and public leaderboards as of July 23, 2026. Early independent API testing includes Simon Willison's write-up. Treat vendor tables accordingly.
- →Moonshot itself says K3 trails Claude Fable 5 and GPT-5.6 Sol overall. Unusual candor for a launch post, and a point in their credibility column.
- →Moonshot's numbers have K3 beating Claude Opus 4.8 and GPT-5.5 on several coding and agentic benchmarks — for how those claims compare to independently-scored models, see the SWE-bench Verified leaderboard explainer.
- →K3.1 Pro: Moonshot's launch post says its offensive-cyber capability remains behind frontier proprietary models; independent scores are still arriving.
Frontend Code Arena at K3's launch (July 2026), as reported in Moonshot's launch coverage:
| Model | Frontend Code Arena (July 2026) |
|---|---|
| Kimi K3 | 1,679 |
| Claude Fable 5 | 1,631 |
| GPT-5.6 Sol | 1,618 |
| GLM-5.2 | 1,587 |
Arena scores move every week. For the current crowd-voted ranking, check where K3 ranks on the Arena (LMArena) leaderboard.
What you can run instead
If K3 sent you here dreaming of frontier-class local AI, here's the realistic ladder, from extreme to actually-attainable:
Kimi K2.7-Code and K2.6 — the runnable Kimi flagships
About 1.03T parameters and 595 GB of weights on Hugging Face. Unsloth's GGUFs of K2.7-Code start at 304 GB (UD-IQ1_M), with 2-bit at 318 GB (UD-IQ2_XXS) and 340 GB (UD-Q2_K_XL) — in reach of a 384-512 GB server or a big multi-GPU rig. Extreme, but real people run it. Family background is in the K3 vs K2 section below.
Kimi-VL-A3B and Moonlight-16B-A3B — Moonshot on consumer hardware
These are the Moonshot models that run on machines normal people own. If you want the Kimi lineage without a server room, this is it.
GLM-5.2 — a frontier-class open model you can actually self-host
If the goal is frontier-class capability you can genuinely run, GLM-5.2 sits one rung below K3 on the Frontend Code Arena board above and is far more practical to self-host. See the free local AI models guide for the full field.
Kimi K3 vs K2: what actually changed
K3 is a scale jump, not a tune-up: 2.8T total and 104B active parameters against about 1.03T for Kimi K2.6 (April 2026) and K2.7-Code (June 2026), a 1M-token context, native vision, and the new KDA attention. Moonshot says the Stable LatentMoE design gives roughly 2.5x better scaling efficiency than K2. The licence changed too: the K2 line uses modified MIT, K3 its own Kimi K3 License.
For local users the comparison is simpler than any spec sheet: the K2 line is the one you can run. K2.7-Code's 2-bit GGUFs are 318-340 GB; K3's smallest 2-bit file is 711 GB and its full weights 1.56 TB. If you're choosing a Kimi model to self-host, start with K2.7-Code for coding or K2.6 for general use.
Bottom line
Kimi K3 is a real open-weight frontier release — 2.8T parameters, a 1M-token context window, weights you can download today — but at 1.56 TB, with GGUFs starting at 466 GB, it is a server model. K3.1 Pro is the newer model to watch, with weights due by November 4, 2026.
The practical playbook: use the API if you want K3 or K3.1, and self-host from the tier below. That means Kimi K2.7-Code on a 384 GB+ machine, or GLM-5.2 for frontier-class capability you can actually run.
FAQ
What is Kimi K3?
When is the Kimi K3.1 release date?
Can I run Kimi K3 locally?
Can a 512 GB Mac Studio run Kimi K3?
Is there a 4-bit or 2-bit Kimi K3?
What licence is Kimi K3 under?
How much does the Kimi K3 API cost?
Related models
- → GLM-5.2 — frontier-class open model, one rung below K3 on Frontend Code Arena
- → DeepSeek V4 — the low-cost-output API comparison
- → GPT-5.6 Sol — the closed model K3 is measured against
- → Qwen3-Coder-Next — our coding-model coverage
- → Free local AI models — the open models you can run at home
Go from reading about AI to building with AI
25 structured courses. Hands-on projects. Runs on your machine. Start free.

Written by
Barsha Mohapatra
Founder and Editor, Local AI Master · Founder, Little AI Master
Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.