Mistral AI · Open-Weight Coding Model
Devstral 2: Mistral's Open Agentic Coding Model
Mistral AI released Devstral 2 on December 9, 2025 as two open-weight coding models: Devstral 2 (123B) and Devstral Small 2 (24B), both with a 256K-token context window. The 24B is the one a single desktop GPU can hold: its Q4_K_M file is 14.33 GB, so it fits a 24 GB card with 16K to 32K of context. The 123B is a 74.9 GB file at the same quantisation and needs about 96 GB of VRAM. Mistral reports 72.2% and 68.0% on SWE-bench Verified. This page has not run either model; every number below is taken from Mistral, Hugging Face or Ollama and linked.
Status, September 2026: Mistral's API documentation now marks both Devstral 2 models as deprecated and points new integrations to Mistral Medium 3.5. The open weights are still on Hugging Face and Ollama, and Devstral Small 2 is still the Mistral coding model sized for one 24 GB card. Details in release date and status.
Devstral hardware requirements: what PC or workstation runs it?
Devstral Small 2 needs a 24 GB graphics card to run at Q4_K_M or better; a 16 GB card can hold the 3-bit files; 8 GB and 12 GB cards cannot hold a usable quantisation entirely in VRAM. Devstral 2 (123B) needs roughly 48 GB for the smallest sensible file and 96 GB for Q4_K_M. Mistral's own guidance is that the 24B is “light enough to run on a single RTX 4090 or a Mac with 32GB RAM” and that the 123B “requires a minimum of 4 H100-class GPUs” for deployment.
How the “memory needed” column is worked out: GGUF file size, plus the key-value cache for a 16K-token context, plus 1 GB for compute buffers. The cache is arithmetic from each model's params.json: layers × KV heads × head dimension × 2 (keys and values) × 2 bytes. For Small 2 that is 40 × 8 × 128 × 2 × 2 = 163,840 bytes per token, or 2.7 GB at 16K. For the 123B it is 88 layers, so 360,448 bytes per token, or 5.9 GB at 16K. File sizes are decimal gigabytes from the Small 2 GGUF repository and the 123B GGUF repository.
Devstral Small 2 (24B)
| Quantisation | GGUF file | Memory needed (16K context) | Fits |
|---|---|---|---|
| IQ3_XXS | 9.28 GB | 13.0 GB | 16 GB card. On a 12 GB card only at about 8K context (11.6 GB). |
| Q3_K_M | 11.47 GB | 15.2 GB | 16 GB card, with almost nothing to spare. |
| Q4_K_M (Ollama 24b, listed as 15GB) | 14.33 GB | 18.0 GB | 24 GB card. Room for 32K context (20.7 GB). |
| Q5_K_M | 16.76 GB | 20.4 GB | 24 GB card at 16K context. |
| Q6_K | 19.35 GB | 23.0 GB | 24 GB card only at 16K or less. |
| Q8_0 (Ollama q8_0, listed as 26GB) | 25.06 GB | 28.7 GB | 32 GB card (RTX 5090). Does not fit 24 GB. |
| BF16 (Ollama fp16, listed as 48GB) | 47.15 GB | 50.8 GB | Two 32 GB cards. Over the limit for 48 GB. |
- 8 GB card: no. The smallest published file (IQ2_XXS) is 6.55 GB, and with an 8K cache and buffer that is 8.9 GB. Ollama will split the model between GPU and system RAM instead, which runs but is slower.
- 12 GB card: only the 3-bit IQ3_XXS file at about 8K context, or a larger file split with system RAM.
- 16 GB card: Q3_K_M at 16K context. Q4_K_M (18.0 GB needed) does not fit.
- 24 GB card: Q4_K_M up to about 32K context, Q5_K_M at 16K.
- The full 256K window costs 42.9 GB of cache on its own at f16, so on a single desktop card you set a much shorter context than the model supports.
Devstral 2 (123B)
| Quantisation | GGUF file | Memory needed (16K context) | Fits |
|---|---|---|---|
| IQ2_XS | 37.32 GB | 44.2 GB | 48 GB: two 24 GB cards. |
| Q2_K | 46.59 GB | 53.5 GB | 64 GB: two 32 GB cards. |
| Q3_K_M | 60.62 GB | 67.5 GB | 72 GB: three 24 GB cards. |
| Q4_K_M (Ollama 123b, listed as 75GB) | 74.90 GB | 81.8 GB | 96 GB: four 24 GB cards or one 96 GB workstation card. |
| Q8_0 (Ollama q8_0, listed as 133GB) | 132.85 GB | 139.8 GB | Two 80 GB data-centre cards. |
The 123B is a dense model, so unlike a Mixture-of-Experts model every weight is used for every token and there is no cheap way to park part of it in system RAM. If your build is one 24 GB card, compare the other models that fit it in best local models for a 24 GB GPU; how the quantisation names trade size for quality is covered in quantization explained.
Release date and current status
| Model | Date | Source |
|---|---|---|
| Devstral Small (2505), first generation | May 2025 (repository created May 12) | Hugging Face |
| Devstral Small (2507) update | July 2025 (repository created July 4) | Hugging Face |
| Devstral 2 (123B) and Devstral Small 2 (24B) | December 9, 2025 | Mistral announcement |
| Mistral Small 4 (folds Devstral into a general model) | March 16, 2026 | Mistral announcement |
| Mistral Medium 3.5 (replaces Devstral 2 in Vibe CLI) | 2026 | Mistral announcement |
There was no Devstral release in June 2026. This page was first published that month, which is why some searches pair the two; the model itself dates from December 2025.
Mistral's model documentation for Devstral 2 and Devstral Small 2 now reads “This model is deprecated. Use Mistral Medium 3.5 for new integrations.” That is about Mistral's hosted API. For running locally the picture is different: Medium 3.5 is a 128B dense model and Mistral Small 4 has 119B total parameters, so neither is a single-card download, while Devstral Small 2 at 24B is. The site's Mistral Medium 3.5 page covers the successor.
Specs at a glance
| Attribute | Devstral 2 (123B) | Devstral Small 2 (24B) |
|---|---|---|
| Release date | December 9, 2025 | December 9, 2025 |
| Parameters | 123B dense (125.0B in the weights file) | 24B (24.0B in the weights file) |
| Layers | 88 | 40 |
| Context window | 256K tokens | 256K tokens (Ollama lists 384K) |
| Tool calling | Yes | Yes |
| Image input | No | Yes |
| Licence | Modified MIT (revenue clause) | Apache 2.0 |
| Ollama name | devstral-2:123b | devstral-small-2:24b |
| Weights | Hugging Face | Hugging Face |
Parameter totals are the safetensors counts reported by the Hugging Face API. Layer counts are from each repository's params.json. Tool and image support are from the model cards and match the capability badges on Ollama.
Devstral 2 benchmarks: what Mistral reports
These figures are Mistral's, copied from the table on both model cards. This site has not reproduced them. SWE-bench Verified measures whether a model, driven by an agent scaffold, can resolve real GitHub issues.
| Benchmark | Devstral 2 (123B) | Devstral Small 2 (24B) |
|---|---|---|
| SWE-bench Verified | 72.2% | 68.0% |
| SWE-bench Multilingual | 61.3% | 55.7% |
| Terminal Bench 2 | 32.6% | 22.5% |
The announcement also describes a human evaluation run by an independent annotation provider with tasks scaffolded through Cline: Devstral 2 had a 42.8% win rate against a 28.6% loss rate versus DeepSeek V3.2, and Mistral states that Claude Sonnet 4.5 “remains significantly preferred”. Mistral later reported 77.6% on SWE-Bench Verified for Medium 3.5, the model that replaced Devstral 2 in its own tools.
Sources: Devstral 2 model card, Devstral 2 announcement, Medium 3.5 announcement. Scores from these benchmarks depend on the agent scaffold, so numbers from different publishers are not directly comparable.
Licensing: the two models differ
Devstral Small 2 (24B): Apache 2.0
A standard permissive licence. The model card describes it as “allowing usage and modification for both commercial and non-commercial purposes”. There is no revenue condition.
Devstral 2 (123B): modified MIT
MIT wording plus one added condition. The licence file says:
“You are not authorized to exercise any rights under this license if the global consolidated monthly revenue of your company (or that of your employer) exceeds $20 million (or its equivalent in another currency) for the preceding month.”
The clause extends to derivatives and combined works. Above that line the licence directs you to request a commercial licence from Mistral or use its hosted service.
Read the licence file itself before you ship anything built on the 123B. This summary is not legal advice.
Ollama tags and install
The plain devstral name on Ollama is not Devstral 2. It resolves to 24b-small-2505-q4_K_M, the first-generation model from May 2025. Devstral 2 lives under two separate library names.
| Ollama tag | Download | What it is |
|---|---|---|
devstral-small-2:24b | 15 GB | Devstral Small 2, q4_K_M. Same as latest. |
devstral-small-2:24b-instruct-2512-q8_0 | 26 GB | Devstral Small 2, q8_0. |
devstral-small-2:24b-instruct-2512-fp16 | 48 GB | Devstral Small 2, fp16. |
devstral-2:123b | 75 GB | Devstral 2, q4_K_M. Same as latest. |
devstral-2:123b-instruct-2512-q8_0 | 133 GB | Devstral 2, q8_0. |
devstral:24b | 14 GB | First-generation Devstral Small 2505, 128K context. Not Devstral 2. |
# Devstral Small 2, q4_K_M, 15 GB download
ollama pull devstral-small-2:24b
ollama run devstral-small-2:24bOllama publishes only three quantisations per model. For the files in between, such as Q5_K_M or the 3-bit files for a 16 GB card, use the GGUF repositories linked in the hardware section with llama.cpp. The model card notes that community GGUF files need a recent llama.cpp build and links the specific change.
Both Devstral 2 models carry Ollama's tools badge, so they work with agents that depend on tool calls. The Cline + Ollama setup guide covers wiring a local model into an editor agent, and Ollama tool calling lists which models support it. Tag list sources: devstral-small-2, devstral-2, devstral.
Mistral Vibe CLI
Mistral shipped Vibe CLI with Devstral 2. The announcement describes it as an open-source command-line coding assistant, released under Apache 2.0, that works in a terminal or inside an editor through the Agent Communication Protocol, and it is available as a Zed extension. The model card gives the install command as uv tool install mistral-vibe. The source is at github.com/mistralai/mistral-vibe.
On first run Vibe asks for a Mistral API key, and Mistral has since made Medium 3.5 its default model. To use it with a local Devstral you have to point it at your own endpoint; check the repository for the current configuration options.
Which one to pick
This section is opinion, based on the sizes and licences above.
| Your hardware | Pick | Why |
|---|---|---|
| One 24 GB card, or a 32 GB Mac | Devstral Small 2 (24B) | Q4_K_M fits with working context, Apache 2.0, and Mistral reports it four points behind the 123B on SWE-bench Verified. |
| 96 GB of VRAM or more | Devstral 2 (123B) | Q4_K_M needs about 82 GB. Check the revenue clause first. |
| 12 GB or 16 GB card | A 14B coding model | Only 3-bit Devstral files fit; a smaller model at 4-bit or better is the safer choice. |
| Comparing coders at this size | Qwen3-Coder | The other open coding family most people weigh against Devstral. |
Frequently asked questions
Can I run Devstral locally?
Yes. Devstral Small 2 is a 14.33 GB file at Q4_K_M and needs about 18 GB with a 16K context, so a 24 GB card holds it. Devstral 2 (123B) is 74.9 GB at Q4_K_M and needs about 82 GB.
When was Devstral 2 released?
December 9, 2025, together with Devstral Small 2 and the Vibe CLI. The first Devstral Small came out in May 2025.
What is the Devstral 2 SWE-bench Verified score?
Mistral reports 72.2% for Devstral 2 and 68.0% for Devstral Small 2. These are vendor figures.
Why does ollama pull devstral give me a 14 GB model?
Because that name is the May 2025 Devstral Small. Pull devstral-small-2 for the December 2025 24B model or devstral-2 for the 123B.
Is Devstral 2 still current?
On Mistral's API it is marked deprecated in favour of Medium 3.5. As a download it is unchanged, and the 24B remains the Mistral coding model that fits a single 24 GB card.
Sources
Build a self-hosted coding agent
The Local AI Master deployment course covers pulling open-weight models such as Devstral and Qwen3-Coder, choosing a quantisation for your GPU, and connecting the model to an editor agent.
See the deployment course →Related models & guides
- → Mistral Medium 3.5: the model Mistral now recommends in place of Devstral 2
- → Qwen3-Coder: the other open-weight coding family
- → Best local AI models for programming
- → Best 14B coding models: for 12 GB and 16 GB cards
- → Cline + Ollama setup
- → Best free local AI models for Ollama
Go from reading about AI to building with AI
25 structured courses. Hands-on projects. Runs on your machine. Start free.

Written by
Barsha Mohapatra
Founder and Editor, Local AI Master · Founder, Little AI Master
Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.