★ Reading this for free? Get 25 structured AI courses + per-chapter AI tutor — the first chapter of every course free, no card.Start free in 30 secondsOr own every course: $149 once

Mistral AI · Open-Weight Coding Model

Devstral 2: Mistral's Open Agentic Coding Model

Mistral AI released Devstral 2 on December 9, 2025 as two open-weight coding models: Devstral 2 (123B) and Devstral Small 2 (24B), both with a 256K-token context window. The 24B is the one a single desktop GPU can hold: its Q4_K_M file is 14.33 GB, so it fits a 24 GB card with 16K to 32K of context. The 123B is a 74.9 GB file at the same quantisation and needs about 96 GB of VRAM. Mistral reports 72.2% and 68.0% on SWE-bench Verified. This page has not run either model; every number below is taken from Mistral, Hugging Face or Ollama and linked.

📅 Published: June 20, 2026🔄 Last Updated: September 29, 2026✓ Manually Reviewed

Status, September 2026: Mistral's API documentation now marks both Devstral 2 models as deprecated and points new integrations to Mistral Medium 3.5. The open weights are still on Hugging Face and Ollama, and Devstral Small 2 is still the Mistral coding model sized for one 24 GB card. Details in release date and status.

Devstral hardware requirements: what PC or workstation runs it?

Devstral Small 2 needs a 24 GB graphics card to run at Q4_K_M or better; a 16 GB card can hold the 3-bit files; 8 GB and 12 GB cards cannot hold a usable quantisation entirely in VRAM. Devstral 2 (123B) needs roughly 48 GB for the smallest sensible file and 96 GB for Q4_K_M. Mistral's own guidance is that the 24B is “light enough to run on a single RTX 4090 or a Mac with 32GB RAM” and that the 123B “requires a minimum of 4 H100-class GPUs” for deployment.

How the “memory needed” column is worked out: GGUF file size, plus the key-value cache for a 16K-token context, plus 1 GB for compute buffers. The cache is arithmetic from each model's params.json: layers × KV heads × head dimension × 2 (keys and values) × 2 bytes. For Small 2 that is 40 × 8 × 128 × 2 × 2 = 163,840 bytes per token, or 2.7 GB at 16K. For the 123B it is 88 layers, so 360,448 bytes per token, or 5.9 GB at 16K. File sizes are decimal gigabytes from the Small 2 GGUF repository and the 123B GGUF repository.

Devstral Small 2 (24B)

QuantisationGGUF fileMemory needed (16K context)Fits
IQ3_XXS9.28 GB13.0 GB16 GB card. On a 12 GB card only at about 8K context (11.6 GB).
Q3_K_M11.47 GB15.2 GB16 GB card, with almost nothing to spare.
Q4_K_M (Ollama 24b, listed as 15GB)14.33 GB18.0 GB24 GB card. Room for 32K context (20.7 GB).
Q5_K_M16.76 GB20.4 GB24 GB card at 16K context.
Q6_K19.35 GB23.0 GB24 GB card only at 16K or less.
Q8_0 (Ollama q8_0, listed as 26GB)25.06 GB28.7 GB32 GB card (RTX 5090). Does not fit 24 GB.
BF16 (Ollama fp16, listed as 48GB)47.15 GB50.8 GBTwo 32 GB cards. Over the limit for 48 GB.
  • 8 GB card: no. The smallest published file (IQ2_XXS) is 6.55 GB, and with an 8K cache and buffer that is 8.9 GB. Ollama will split the model between GPU and system RAM instead, which runs but is slower.
  • 12 GB card: only the 3-bit IQ3_XXS file at about 8K context, or a larger file split with system RAM.
  • 16 GB card: Q3_K_M at 16K context. Q4_K_M (18.0 GB needed) does not fit.
  • 24 GB card: Q4_K_M up to about 32K context, Q5_K_M at 16K.
  • The full 256K window costs 42.9 GB of cache on its own at f16, so on a single desktop card you set a much shorter context than the model supports.

Devstral 2 (123B)

QuantisationGGUF fileMemory needed (16K context)Fits
IQ2_XS37.32 GB44.2 GB48 GB: two 24 GB cards.
Q2_K46.59 GB53.5 GB64 GB: two 32 GB cards.
Q3_K_M60.62 GB67.5 GB72 GB: three 24 GB cards.
Q4_K_M (Ollama 123b, listed as 75GB)74.90 GB81.8 GB96 GB: four 24 GB cards or one 96 GB workstation card.
Q8_0 (Ollama q8_0, listed as 133GB)132.85 GB139.8 GBTwo 80 GB data-centre cards.

The 123B is a dense model, so unlike a Mixture-of-Experts model every weight is used for every token and there is no cheap way to park part of it in system RAM. If your build is one 24 GB card, compare the other models that fit it in best local models for a 24 GB GPU; how the quantisation names trade size for quality is covered in quantization explained.

Release date and current status

ModelDateSource
Devstral Small (2505), first generationMay 2025 (repository created May 12)Hugging Face
Devstral Small (2507) updateJuly 2025 (repository created July 4)Hugging Face
Devstral 2 (123B) and Devstral Small 2 (24B)December 9, 2025Mistral announcement
Mistral Small 4 (folds Devstral into a general model)March 16, 2026Mistral announcement
Mistral Medium 3.5 (replaces Devstral 2 in Vibe CLI)2026Mistral announcement

There was no Devstral release in June 2026. This page was first published that month, which is why some searches pair the two; the model itself dates from December 2025.

Mistral's model documentation for Devstral 2 and Devstral Small 2 now reads “This model is deprecated. Use Mistral Medium 3.5 for new integrations.” That is about Mistral's hosted API. For running locally the picture is different: Medium 3.5 is a 128B dense model and Mistral Small 4 has 119B total parameters, so neither is a single-card download, while Devstral Small 2 at 24B is. The site's Mistral Medium 3.5 page covers the successor.

Specs at a glance

AttributeDevstral 2 (123B)Devstral Small 2 (24B)
Release dateDecember 9, 2025December 9, 2025
Parameters123B dense (125.0B in the weights file)24B (24.0B in the weights file)
Layers8840
Context window256K tokens256K tokens (Ollama lists 384K)
Tool callingYesYes
Image inputNoYes
LicenceModified MIT (revenue clause)Apache 2.0
Ollama namedevstral-2:123bdevstral-small-2:24b
WeightsHugging FaceHugging Face

Parameter totals are the safetensors counts reported by the Hugging Face API. Layer counts are from each repository's params.json. Tool and image support are from the model cards and match the capability badges on Ollama.

Devstral 2 benchmarks: what Mistral reports

These figures are Mistral's, copied from the table on both model cards. This site has not reproduced them. SWE-bench Verified measures whether a model, driven by an agent scaffold, can resolve real GitHub issues.

BenchmarkDevstral 2 (123B)Devstral Small 2 (24B)
SWE-bench Verified72.2%68.0%
SWE-bench Multilingual61.3%55.7%
Terminal Bench 232.6%22.5%

The announcement also describes a human evaluation run by an independent annotation provider with tasks scaffolded through Cline: Devstral 2 had a 42.8% win rate against a 28.6% loss rate versus DeepSeek V3.2, and Mistral states that Claude Sonnet 4.5 “remains significantly preferred”. Mistral later reported 77.6% on SWE-Bench Verified for Medium 3.5, the model that replaced Devstral 2 in its own tools.

Sources: Devstral 2 model card, Devstral 2 announcement, Medium 3.5 announcement. Scores from these benchmarks depend on the agent scaffold, so numbers from different publishers are not directly comparable.

Licensing: the two models differ

Devstral Small 2 (24B): Apache 2.0

A standard permissive licence. The model card describes it as “allowing usage and modification for both commercial and non-commercial purposes”. There is no revenue condition.

Devstral 2 (123B): modified MIT

MIT wording plus one added condition. The licence file says:

“You are not authorized to exercise any rights under this license if the global consolidated monthly revenue of your company (or that of your employer) exceeds $20 million (or its equivalent in another currency) for the preceding month.”

The clause extends to derivatives and combined works. Above that line the licence directs you to request a commercial licence from Mistral or use its hosted service.

Read the licence file itself before you ship anything built on the 123B. This summary is not legal advice.

Ollama tags and install

The plain devstral name on Ollama is not Devstral 2. It resolves to 24b-small-2505-q4_K_M, the first-generation model from May 2025. Devstral 2 lives under two separate library names.

Ollama tagDownloadWhat it is
devstral-small-2:24b15 GBDevstral Small 2, q4_K_M. Same as latest.
devstral-small-2:24b-instruct-2512-q8_026 GBDevstral Small 2, q8_0.
devstral-small-2:24b-instruct-2512-fp1648 GBDevstral Small 2, fp16.
devstral-2:123b75 GBDevstral 2, q4_K_M. Same as latest.
devstral-2:123b-instruct-2512-q8_0133 GBDevstral 2, q8_0.
devstral:24b14 GBFirst-generation Devstral Small 2505, 128K context. Not Devstral 2.
# Devstral Small 2, q4_K_M, 15 GB download
ollama pull devstral-small-2:24b
ollama run devstral-small-2:24b

Ollama publishes only three quantisations per model. For the files in between, such as Q5_K_M or the 3-bit files for a 16 GB card, use the GGUF repositories linked in the hardware section with llama.cpp. The model card notes that community GGUF files need a recent llama.cpp build and links the specific change.

Both Devstral 2 models carry Ollama's tools badge, so they work with agents that depend on tool calls. The Cline + Ollama setup guide covers wiring a local model into an editor agent, and Ollama tool calling lists which models support it. Tag list sources: devstral-small-2, devstral-2, devstral.

Mistral Vibe CLI

Mistral shipped Vibe CLI with Devstral 2. The announcement describes it as an open-source command-line coding assistant, released under Apache 2.0, that works in a terminal or inside an editor through the Agent Communication Protocol, and it is available as a Zed extension. The model card gives the install command as uv tool install mistral-vibe. The source is at github.com/mistralai/mistral-vibe.

On first run Vibe asks for a Mistral API key, and Mistral has since made Medium 3.5 its default model. To use it with a local Devstral you have to point it at your own endpoint; check the repository for the current configuration options.

Which one to pick

This section is opinion, based on the sizes and licences above.

Your hardwarePickWhy
One 24 GB card, or a 32 GB MacDevstral Small 2 (24B)Q4_K_M fits with working context, Apache 2.0, and Mistral reports it four points behind the 123B on SWE-bench Verified.
96 GB of VRAM or moreDevstral 2 (123B)Q4_K_M needs about 82 GB. Check the revenue clause first.
12 GB or 16 GB cardA 14B coding modelOnly 3-bit Devstral files fit; a smaller model at 4-bit or better is the safer choice.
Comparing coders at this sizeQwen3-CoderThe other open coding family most people weigh against Devstral.

Frequently asked questions

Can I run Devstral locally?

Yes. Devstral Small 2 is a 14.33 GB file at Q4_K_M and needs about 18 GB with a 16K context, so a 24 GB card holds it. Devstral 2 (123B) is 74.9 GB at Q4_K_M and needs about 82 GB.

When was Devstral 2 released?

December 9, 2025, together with Devstral Small 2 and the Vibe CLI. The first Devstral Small came out in May 2025.

What is the Devstral 2 SWE-bench Verified score?

Mistral reports 72.2% for Devstral 2 and 68.0% for Devstral Small 2. These are vendor figures.

Why does ollama pull devstral give me a 14 GB model?

Because that name is the May 2025 Devstral Small. Pull devstral-small-2 for the December 2025 24B model or devstral-2 for the 123B.

Is Devstral 2 still current?

On Mistral's API it is marked deprecated in favour of Medium 3.5. As a download it is unchanged, and the 24B remains the Mistral coding model that fits a single 24 GB card.

Sources

Build a self-hosted coding agent

The Local AI Master deployment course covers pulling open-weight models such as Devstral and Qwen3-Coder, choosing a quantisation for your GPU, and connecting the model to an editor agent.

See the deployment course →

Related models & guides

🎯
AI Learning Path

Go from reading about AI to building with AI

25 structured courses. Hands-on projects. Runs on your machine. Start free.

Or own it for life — Lifetime $149 $599, pay once
Barsha Mohapatra

Written by

Barsha Mohapatra

Founder and Editor, Local AI Master · Founder, Little AI Master

Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.

More on AI Models Directory
See the full AI Models Directory guide.
📚
Free · no account required

Grab the AI Starter Kit — career roadmap, cheat sheet, setup guide

No spam. Unsubscribe with one click.

🎯
AI Learning Path

Found your model? Now build something with it.

25 hands-on courses — RAG, agents, fine-tuning — all running locally. First chapter free, no card.

Or own it for life — Lifetime $149 $599, pay once
Free Tools & Calculators