★ Reading this for free? Get 25 structured AI courses + per-chapter AI tutor — the first chapter of every course free, no card.Start free in 30 secondsOr own every course: $149 once

Moonshot AI · 2.8T MoE · Weights out July 27, 2026 · K3.1 Pro weights due Nov 4

Kimi K3 & K3.1: Release Date, Weights and Local Specs

Kimi K3 was announced on July 16, 2026 and its weights went up on Hugging Face on July 27: a 2.8-trillion-parameter Mixture-of-Experts model with 104B active parameters, a 1M-token context and 1.56 TB of MXFP4 weights. Its successor, Kimi K3.1 Pro, rolled out through Moonshot's apps and API on October 23, 2026, with weights promised by November 4. You can download K3, but the smallest community GGUF is 466 GB, so running it locally means a machine with around half a terabyte of memory or more.

📅 Published: July 20, 2026🔄 Last Updated: November 2, 2026✓ Manually Reviewed

Status — as of November 2, 2026

Kimi K3: open weights on Hugging Face under the Kimi K3 License; GGUFs from Unsloth (466 GB to 1,561 GB) that need Unsloth's llama.cpp fork; NVFP4 build from NVIDIA; on Ollama only as the cloud-hosted kimi-k3:cloud, with no local Ollama tag. Kimi K3.1 Pro: API and apps since October 23; weights due by November 4, 2026. We will update this page when they land.

Key takeaways

  • →2.8T total, 104B active — 16 of 896 experts plus 2 shared per token. Roughly 2.7x the 1.03T Kimi K2.6 and K2.7-Code.
  • →1.56 TB at native 4-bit (MXFP4) — trained quantisation-aware, so the release is already 4-bit. The smallest GGUF is 466 GB (1-bit); 2-bit starts at 711 GB.
  • →K3.1 Pro: October 23, 2026 on the API and apps; open weights due by November 4, with cyber-related training data removed from the open release.
  • →Licence: Kimi K3 License — MIT-style, with an extra agreement needed only for model-as-a-service businesses above US$20M revenue.
  • →Want something you can run? The Kimi K2 line from about 304 GB, or GLM-5.2 and other models in the free local AI models guide.

Quick answer

If you came here to find out which GPU runs Kimi K3: none on its own. Even the most aggressive GGUF, Unsloth's 466 GB UD-Q1_0, is larger than any single card or most workstations. K3 is built for multi-GPU servers; Moonshot's model card recommends vLLM, SGLang or TokenSpeed to serve it, and the 1.56 TB official weights are already 4-bit, so there is no 8-bit-to-4-bit saving left to take.

The practical playbook: use the K3 or K3.1 API if you want the model, and self-host from the tier below it. The Kimi K2 line is the runnable branch of the family, and GLM-5.2 is a frontier-class open model that is far more practical to self-host.

Kimi K3.1 Pro: release date and weights

Kimi K3.1 Pro rolled out on October 23, 2026, according to Moonshot's launch post, on Kimi.com, the mobile apps, Kimi Work, Kimi Code and the Kimi API, with a 1-million-token context. Moonshot calls it its most capable “3T-class open-weight” model and says the full weights are due by November 4, 2026.

One detail matters for anyone planning to self-host: Moonshot says it identified and removed cyber-related data from both training stages of the open-weight release, and reports its internal offensive-security test score dropping as a result. The open K3.1 weights will therefore not be identical in behaviour to the API model.

Moonshot has not published a parameter count for K3.1 Pro beyond “3T-class”, so plan on hardware at least as large as K3's until the files are on Hugging Face and their size is known.

Kimi K3 specs at a glance

VendorMoonshot AI
LaunchedJuly 16, 2026 (API/app); weights on Hugging Face July 27, 2026
ArchitectureMixture-of-Experts — 16 of 896 routed experts plus 2 shared per token
Total / active parameters2.8 trillion / 104 billion
Layers93: 69 Kimi Delta Attention (KDA) + 24 gated MLA; hidden size 7,168
Context window1,048,576 tokens
VisionNative: MoonViT-V2 encoder (401M parameters), text + image input
Native weight formatMXFP4 weights / MXFP8 activations, quantisation-aware training
Weight size1.56 TB (Hugging Face repo)
LicenseKimi K3 License (MIT-style with commercial conditions)
Local runtimesUnsloth GGUFs via Unsloth's llama.cpp fork; no local Ollama tag (only kimi-k3:cloud)
Recommended servingvLLM, SGLang, TokenSpeed on multi-GPU servers

Source: the moonshotai/Kimi-K3 model card. One naming note: you'll occasionally see this model called "Kimi V3." There is no Kimi V3 — the real name is K3, the successor to the K2 line.

Release date & license

K3 launched July 16, 2026 through Moonshot's API and app — see Moonshot's official Kimi K3 announcement. Moonshot had promised open weights by July 27, and kept the date: the full weights, the technical report and a KDA prefix-caching implementation for vLLM were published that day.

The licence turned out to be its own text, the Kimi K3 License, rather than the modified MIT of the K2 line. It grants the usual MIT rights, then adds two conditions: a company running a model-as-a-service business with more than US$20 million revenue over 12 months must sign a separate agreement before commercial use, and products with more than 100 million monthly users or US$20 million monthly revenue must display “Kimi K3”. Internal use is exempt from both.

The vLLM integration means multi-node operators had a serving path on day one. KDA is a new attention design, so llama.cpp support arrived through Unsloth's fork rather than a release of mainline llama.cpp, and Ollama offers K3 only as a cloud model.

Can you run it locally? Only on very big iron

The arithmetic, with real file sizes now that the weights are out:

The weights are already 4-bit

K3's native format is MXFP4. With most models, "just quantize it to 4-bit" cuts the size roughly 4×. K3 starts there — 1.56 TB at native 4-bit — so the usual escape hatch is gone before you open it. Unsloth's own 4-bit GGUF is 1,509 GB, barely smaller.

The 2-bit and 1-bit files are still enormous

Unsloth's 2-bit files are 711 GB (UD-IQ2_XXS) and 861 GB (UD-Q2_K_XL); the 1-bit UD-Q1_0 is 466 GB. A 512 GB Mac Studio is the only single consumer machine near the smallest one, and with macOS keeping part of unified memory for itself, there is almost no room left for context.

Moonshot's guidance is server-class

The model card lists vLLM, SGLang and TokenSpeed as the recommended engines, all aimed at multi-GPU servers with tensor and expert parallelism. Not an 8 GB gaming card, not a single workstation GPU.

No speed figure here, on purpose

Mixture-of-experts speed depends on which experts each token touches and where they sit (VRAM, RAM or disk), so the simple bandwidth ceiling this site uses for dense models does not apply. Any page quoting a K3 tokens-per-second figure for a home machine without saying how it was measured is guessing.

Kimi K3 GGUF sizes and the hardware they need

Sizes from unsloth/Kimi-K3-GGUF (total of the split files). You need at least the file size in combined RAM and VRAM, plus room for the context cache.

BuildSizeNote
UD-Q1_0466 GBSmallest file; only a 512 GB machine comes close
UD-TQ1_0509 GB
UD-IQ1_S594 GB
UD-IQ2_XXS711 GBSmallest 2-bit
UD-Q2_K_XL861 GB1 TB RAM server, or RAM + several GPUs
UD-Q4_K_XL1,509 GBClose to the original MXFP4 size
UD-Q8_K_XL1,561 GBLossless relative to the MXFP4 release
Official MXFP4 (safetensors)1,561 GBFor vLLM / SGLang on multi-GPU servers

Unsloth's README says to run these with its llama.cpp PR fork or Unsloth Studio. NVIDIA publishes nvidia/Kimi-K3-NVFP4 for Blackwell-class servers.

API pricing

For most people the API is the practical way to use K3. Launch pricing (July 2026), flat across all context lengths:

MetricKimi K3 (launch)Kimi K3.1 Pro (Vals AI listing)
Input (cache miss)$3.00 / MTok$2.00 / MTok
Input (cache hit)$0.30 / MToknot listed
Output$15.00 / MTok$10.00 / MTok

At launch Moonshot reported over 90% cache hits on coding workloads, which would put most input at the $0.30 rate. Output is where K3 was premium-priced; for comparison, DeepSeek V4 lists far cheaper output. Check Moonshot's platform for current prices.

Benchmarks — Moonshot's claims, labeled as such

The model card's evaluation tables are Moonshot's own runs, mostly with its Kimi Code harness, mixed with scores it cites from Artificial Analysis and public leaderboards as of July 23, 2026. Early independent API testing includes Simon Willison's write-up. Treat vendor tables accordingly.

  • →Moonshot itself says K3 trails Claude Fable 5 and GPT-5.6 Sol overall. Unusual candor for a launch post, and a point in their credibility column.
  • →Moonshot's numbers have K3 beating Claude Opus 4.8 and GPT-5.5 on several coding and agentic benchmarks — for how those claims compare to independently-scored models, see the SWE-bench Verified leaderboard explainer.
  • →K3.1 Pro: Moonshot's launch post says its offensive-cyber capability remains behind frontier proprietary models; independent scores are still arriving.

Frontend Code Arena at K3's launch (July 2026), as reported in Moonshot's launch coverage:

ModelFrontend Code Arena (July 2026)
Kimi K31,679
Claude Fable 51,631
GPT-5.6 Sol1,618
GLM-5.21,587

Arena scores move every week. For the current crowd-voted ranking, check where K3 ranks on the Arena (LMArena) leaderboard.

What you can run instead

If K3 sent you here dreaming of frontier-class local AI, here's the realistic ladder, from extreme to actually-attainable:

Kimi K2.7-Code and K2.6 — the runnable Kimi flagships

About 1.03T parameters and 595 GB of weights on Hugging Face. Unsloth's GGUFs of K2.7-Code start at 304 GB (UD-IQ1_M), with 2-bit at 318 GB (UD-IQ2_XXS) and 340 GB (UD-Q2_K_XL) — in reach of a 384-512 GB server or a big multi-GPU rig. Extreme, but real people run it. Family background is in the K3 vs K2 section below.

Kimi-VL-A3B and Moonlight-16B-A3B — Moonshot on consumer hardware

These are the Moonshot models that run on machines normal people own. If you want the Kimi lineage without a server room, this is it.

GLM-5.2 — a frontier-class open model you can actually self-host

If the goal is frontier-class capability you can genuinely run, GLM-5.2 sits one rung below K3 on the Frontend Code Arena board above and is far more practical to self-host. See the free local AI models guide for the full field.

Kimi K3 vs K2: what actually changed

K3 is a scale jump, not a tune-up: 2.8T total and 104B active parameters against about 1.03T for Kimi K2.6 (April 2026) and K2.7-Code (June 2026), a 1M-token context, native vision, and the new KDA attention. Moonshot says the Stable LatentMoE design gives roughly 2.5x better scaling efficiency than K2. The licence changed too: the K2 line uses modified MIT, K3 its own Kimi K3 License.

For local users the comparison is simpler than any spec sheet: the K2 line is the one you can run. K2.7-Code's 2-bit GGUFs are 318-340 GB; K3's smallest 2-bit file is 711 GB and its full weights 1.56 TB. If you're choosing a Kimi model to self-host, start with K2.7-Code for coding or K2.6 for general use.

Bottom line

Kimi K3 is a real open-weight frontier release — 2.8T parameters, a 1M-token context window, weights you can download today — but at 1.56 TB, with GGUFs starting at 466 GB, it is a server model. K3.1 Pro is the newer model to watch, with weights due by November 4, 2026.

The practical playbook: use the API if you want K3 or K3.1, and self-host from the tier below. That means Kimi K2.7-Code on a 384 GB+ machine, or GLM-5.2 for frontier-class capability you can actually run.

FAQ

What is Kimi K3?
Kimi K3 is Moonshot AI's open-weight Mixture-of-Experts model, announced July 16, 2026. Its model card lists 2.8 trillion total parameters with 104B activated per token (16 of 896 experts plus 2 shared), 93 layers mixing Kimi Delta Attention and gated MLA, a 1,048,576-token context window and native image input. The weights were published on Hugging Face (moonshotai/Kimi-K3) on July 27, 2026, in MXFP4.
When is the Kimi K3.1 release date?
Kimi K3.1 Pro rolled out on October 23, 2026 across Kimi.com, the apps, Kimi Code and the API. Moonshot's launch post says the full weights are due by November 4, 2026. As of November 2 they are not yet on Hugging Face. Moonshot says it removed cyber-related training data from the open-weight version.
Can I run Kimi K3 locally?
Only on very large machines. The official MXFP4 weights are 1.56 TB. Unsloth's GGUF conversions start at 466 GB (UD-Q1_0) and reach 861 GB at UD-Q2_K_XL and 1,509 GB at UD-Q4_K_XL, and they need Unsloth's llama.cpp fork. Even the 1-bit file is more than any single consumer GPU holds; it needs about 512 GB of combined RAM and VRAM, at a large quality cost. For real use, Moonshot recommends multi-GPU serving with vLLM, SGLang or TokenSpeed.
Can a 512 GB Mac Studio run Kimi K3?
Only the smallest GGUF, UD-Q1_0 at 466 GB, is smaller than 512 GB, and macOS reserves part of unified memory for the system, so the GPU limit has to be raised and almost nothing is left for context. Expect it to load at best, with 1-bit quality. Two machines, or a server with 768 GB to 1 TB of RAM, is the realistic floor for the 2-bit files.
Is there a 4-bit or 2-bit Kimi K3?
The official weights already are 4-bit: Moonshot trained K3 with quantisation-aware training for MXFP4 weights, which is why the release is 1.56 TB rather than over 5 TB. Unsloth's 4-bit GGUF (UD-Q4_K_XL) is 1,509 GB. The 2-bit options are UD-IQ2_XXS (711 GB) and UD-Q2_K_XL (861 GB). NVIDIA also publishes an NVFP4 build for its Blackwell GPUs.
What licence is Kimi K3 under?
The Kimi K3 License. It grants MIT-style rights to use, modify and redistribute, with two conditions: a company running a model-as-a-service business with more than US$20 million in revenue over 12 months needs a separate agreement with Moonshot, and products above 100 million monthly users or US$20 million monthly revenue must display "Kimi K3". Internal use is exempt from both.
How much does the Kimi K3 API cost?
At launch Moonshot priced K3 at $3.00 per million input tokens on a cache miss, $0.30 on a cache hit and $15.00 per million output tokens, flat across context lengths. K3.1 Pro is listed at $2.00 input and $10.00 output per million tokens by Vals AI. Check Moonshot's platform for current prices before budgeting.

Related models

🎯
AI Learning Path

Go from reading about AI to building with AI

25 structured courses. Hands-on projects. Runs on your machine. Start free.

Or own it for life — Lifetime $149 $599, pay once
Barsha Mohapatra

Written by

Barsha Mohapatra

Founder and Editor, Local AI Master · Founder, Little AI Master

Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.

More on AI Models Directory
See the full AI Models Directory guide.
📚
Free · no account required

Grab the AI Starter Kit — career roadmap, cheat sheet, setup guide

No spam. Unsubscribe with one click.

🎯
AI Learning Path

Found your model? Now build something with it.

25 hands-on courses — RAG, agents, fine-tuning — all running locally. First chapter free, no card.

Or own it for life — Lifetime $149 $599, pay once
Free Tools & Calculators