Best AI Coding Models 2026: Top 12 Ranked on SWE-Bench
Want to go deeper than this article?
Free account unlocks the first chapter of all 25 courses — RAG, agents, MCP, voice AI, MLOps, real GitHub repos.
Picked your coding model? Build a real AI dev workflow. From local copilots to agents that ship code — the structured path, running on your hardware. First chapter free.
Last updated October 15, 2026. Every figure below is quoted from a public leaderboard or a vendor's own documentation, with the link next to it. This site did not run any of these benchmarks. Sections marked as recommendation are editorial judgment.
Quick answer: which AI coding model ranks first?
On the official SWE-bench Verified leaderboard, the highest score in the like-for-like comparison (every model driven by the same minimal agent, mini-SWE-agent 2.0) is Claude 4.5 Opus at 76.8%, followed by Gemini 3 Flash and MiniMax M2.5 at 75.8% and Claude 4.6 Opus at 75.6%. That board was last updated on February 26, 2026, so it does not yet include the models the three big vendors sell today: Claude Opus 5.5 and Fable 5.1, GPT-6 Astra, Gemini 4 Argon and Gemini 3.8 Flash.
So the honest answer has two parts. The ranking below is the newest independent one that exists. The model to actually use is usually the current successor of whatever ranks well, and the per-vendor section lists those with their real prices. If you want to run a model on your own machine instead, skip to the local ranking.
Reading articles is good. Building is better.
Free account = the first chapter of all 25 courses, with a per-chapter AI tutor. No card.
SWE-bench Verified ranking: the top 12
SWE-bench Verified is a human-filtered set of 500 real GitHub issues. A model is given the repository and the issue text and has to produce a patch that makes the project's tests pass. The rows below all use the leaderboard's bash-only setting: one simple agent loop, no custom tooling, so the difference between rows is the model and not the scaffolding around it.
| Rank | Model | % resolved | Maker | Entry date |
|---|---|---|---|---|
| 1 | Claude 4.5 Opus (high) | 76.8 | Anthropic | 2026-02-17 |
| 2 | Gemini 3 Flash (high) | 75.8 | 2026-02-17 | |
| 2 | MiniMax M2.5 (high) | 75.8 | MiniMax | 2026-02-17 |
| 4 | Claude 4.6 Opus | 75.6 | Anthropic | 2026-02-17 |
| 5 | GLM 5 (high) | 72.8 | Z.ai | 2026-02-17 |
| 5 | GPT 5.2 (high) | 72.8 | OpenAI | 2026-02-17 |
| 5 | GPT 5.2 Codex | 72.8 | OpenAI | 2026-02-19 |
| 8 | Claude 4.5 Sonnet (high) | 71.4 | Anthropic | 2026-02-17 |
| 9 | Kimi K2.5 (high) | 70.8 | Moonshot AI | 2026-02-17 |
| 10 | DeepSeek V3.2 (high) | 70.0 | DeepSeek | 2026-02-17 |
| 11 | Gemini 3 Pro | 69.6 | 2026-02-26 | |
| 12 | Claude 4.5 Haiku (high) | 66.6 | Anthropic | 2026-02-17 |
Source: swebench.com, Verified board, mini-SWE-agent 2.0.0 entries, read on September 29, 2026. The board renders its rows with JavaScript and had no newer entries when re-checked on October 15, 2026.
Three things to take from it:
- The top four are inside 1.2 points of each other. With 500 tasks, one point is five issues. Do not choose between those models on this number.
- Custom agents score higher than the bare model. The same board lists Claude 4.5 Opus at 79.2% inside two third-party agent systems. When a vendor quotes a bigger number than the table above, it is usually a different harness, not a different model.
- SWE-bench is a Python benchmark. The original dataset is 2,294 problems from 12 Python repositories (paper), and Verified is a subset of it. It says little about how a model handles TypeScript, Go or Rust. For those, see the per-language section below.
For a longer explanation of how the benchmark is built and where it misleads, see SWE-bench explained.
Current models the leaderboard has not scored yet
Every model in the ranking above has since been replaced or joined by a newer one. These are the models the vendors list as current, with the prices and limits from their own documentation. None of them has an entry on the official SWE-bench Verified board yet, so this table has no score column.
| Model | Maker | Input / output per 1M tokens | Context window | How the vendor describes it |
|---|---|---|---|---|
| Claude Fable 5.1 | Anthropic | $10 / $50 | 1M | Demanding reasoning and long-horizon agentic work |
| Claude Opus 5.5 | Anthropic | $4 / $20 | 1M | Long-running agentic coding and knowledge work |
| Claude Sonnet 5.5 | Anthropic | $2 / $10 | 1M | Best combination of speed and intelligence |
| Claude Haiku 5.5 | Anthropic | from $0.10 / $0.50 | 1M | High-volume, latency-sensitive tasks |
| GPT-6 Astra | OpenAI | $10 / $50 | 1.05M | Most capable model for the most demanding work |
| GPT-6.1 Sol | OpenAI | $2 / $10 | 1.05M | Near-Astra performance for complex work at a lower cost |
| GPT-6 Luna | OpenAI | $0.10 / $0.50 | 1.05M | Most efficient model for focused, high-volume tasks |
| Gemini 4 Argon | $2 / $10 until Nov 30, 2026, then $4 / $20 | 1M | Flagship reasoning model | |
| Gemini 3.8 Flash | $0.75 / $3.75 until Dec 31, 2026, then $1.50 / $7.50 | 1M in, 65,536 out | Long-horizon software engineering and agents |
Sources: Anthropic models overview and pricing; OpenAI models and pricing (short-context standard rates); Gemini API pricing and models. Read on October 15, 2026. Prices change, so check the vendor page before you budget.
Anthropic released Claude Opus 5.5 on September 22, 2026. Its announcement reports 66.4% on Terminal-Bench 4.0, against 57.9% for GPT-6 Astra and 52.3% for the previous Claude Opus 5. That is a vendor's own measurement of its own model, published in a launch post. Treat it as a claim to be checked, not as an independent ranking.
Older models named on earlier versions of this page have been superseded: Claude 4 Sonnet and Claude Opus 4 are retired on Anthropic's API, GPT-5.5 is now listed by OpenAI as a previous-generation model at $5 / $30, and Google lists Gemini 3.1 Pro Preview as shut down.
Ranked by vendor: Claude, GPT and Gemini models for coding
Most searches that land here ask a narrower question: which Claude, which GPT, or which Gemini. Each table lists the vendor's current and still-available models with the official-board score where one exists. A blank cell means no entry on swebench.com.
Which Claude model is best for coding?
| Model | Status (Anthropic) | Price per 1M | SWE-bench Verified (official board) |
|---|---|---|---|
| Claude Fable 5.1 | Current; "demanding reasoning and long-horizon agentic work" | $10 / $50 | |
| Claude Opus 5.5 | Current; recommended starting point "for most workloads" | $4 / $20 | |
| Claude Sonnet 5.5 | Current | $2 / $10 | |
| Claude Haiku 5.5 | Current | from $0.10 / $0.50 | |
| Claude Opus 4.6 | Legacy, still available | see pricing page | 75.6 |
| Claude Opus 4.5 | Legacy, still available | see pricing page | 76.8 |
| Claude Sonnet 4.6 / Sonnet 5 | Legacy, still available | see pricing page | |
| Claude 4.5 Sonnet | Retired on the API | 71.4 | |
| Claude 4.5 Haiku | Legacy, still available | see pricing page | 66.6 |
| Claude 3.5 Sonnet (Oct 2024) | Retired | 49.0 (Anthropic's announcement, not the current board) |
Sources: Anthropic models overview (status and prices, read October 15, 2026); swebench.com (scores); Anthropic, October 22, 2024 for the 3.5 Sonnet figure.
Recommendation: Anthropic's own documentation says to start with Opus 5.5 and move to Fable 5.1 only when Opus "at higher effort" still falls short. For routine work Sonnet 5.5 is the price-sensible pick. The highest Claude score on the independent board belongs to a previous generation (4.5 Opus, 76.8%), which is a statement about the board's age rather than the models. The Claude model guide goes tier by tier, and the Claude Code offline guide covers running the agent against a local model.
Which GPT model is best for coding?
| Model | Status (OpenAI) | Price per 1M | Independent score |
|---|---|---|---|
| GPT-6 Astra | Current; "most capable model for the most demanding work" | $10 / $50 | |
| GPT-6.1 Sol | Current; "near-Astra performance … at a lower cost" | $2 / $10 | |
| GPT-6 Sol | Current | $2 / $10 | |
| GPT-6 Luna | Current; "focused, high-volume tasks" | $0.10 / $0.50 | |
| GPT-5.6 Sol / Terra / Luna | Previous generation | $4 / $20; $2 / $12; $0.20 / $1.20 | |
| GPT-5.5 | Previous generation | $5 / $30 | |
| GPT-5.4 | Previous generation | $2.50 / $15 | 59.10 on SWE-Bench Pro (Scale) |
| GPT 5.2 / 5.2 Codex | Not on the current price list | 72.8 Verified (official board) | |
| GPT-5 | Previous generation | $1.25 / $10 | 88.0% Aider polyglot (high); 41.78 SWE-Bench Pro |
| GPT-4o | Previous generation | $2.50 / $10 | OpenAI's Verified post was unreachable when checked; not quoted |
Sources: OpenAI pricing and models, read October 15, 2026; swebench.com; Scale SWE-Bench Pro; Aider.
Recommendation: GPT-6.1 Sol for daily work, GPT-6 Astra for the hardest multi-file jobs, GPT-6 Luna for bulk edits. OpenAI lists no dedicated Codex model in the current catalogue; the general models power Codex CLI, which can also be pointed at a local model (guide). Our GPT-5.5 page covers the previous flagship.
Which Google model is best for coding?
| Model | Status (Google) | Price per 1M | SWE-bench Verified (official board) |
|---|---|---|---|
| Gemini 4 Argon | Current flagship reasoning model | $2 / $10 until Nov 30, 2026, then $4 / $20 | |
| Gemini 3.8 Flash | Current; "long-horizon software engineering, autonomous agents" | $0.75 / $3.75 until Dec 31, 2026 | |
| Gemini 3.6 Flash | Previous generation | $0.75 / $3.75 until Dec 31, 2026 | |
| Gemini 3 Flash | Not on the current price list | 75.8 | |
| Gemini 3 Pro | Not on the current price list | 69.6 | |
| Gemini 3.1 Pro Preview | Shut down | 46.10 on SWE-Bench Pro (Scale) | |
| Gemini 2.5 Pro | Legacy | $1.25 / $10 up to 200K | 83.1% Aider polyglot (06-05 preview, 32k think) |
Sources: Gemini pricing and models, read October 15, 2026; swebench.com; Scale; Aider.
Recommendation: Gemini 3.8 Flash is the value pick while its promotional price lasts, and Google's own description aims it at software engineering. On the official board the cheaper Gemini 3 Flash outscored Gemini 3 Pro, so do not assume the larger model is the better coder. For a three-way comparison of the chat products, see ChatGPT vs Claude vs Gemini for coding.
Run this on your own machine and stop paying every month
Pay once and keep it. No renewal, no per-token bill, and nothing you feed it ever leaves your hardware.
SWE-Bench Pro: the harder, multi-language ranking
SWE-Bench Pro, run by Scale AI, covers Python, Go, JavaScript and TypeScript; the public set has 731 instances. Scores are much lower than on Verified, which is the point: the tasks are longer and less likely to have leaked into training data.
| Rank | Model | Score (public set) |
|---|---|---|
| 1 | Muse Spark 1.1 | 61.50 ± 3.10 |
| 2 | GPT-5.4 (xHigh) | 59.10 ± 3.56 |
| 3 | Muse Spark | 55.00 ± 3.60 |
| 4 | Claude Opus 4.6 (thinking) | 51.90 ± 3.61 |
| 5 | Gemini 3.1 Pro (thinking) | 46.10 ± 3.60 |
| 6 | Claude Opus 4.5 | 45.89 ± 3.60 |
| 7 | Claude 4.5 Sonnet | 43.60 ± 3.60 |
| 8 | Gemini 3 Pro preview | 43.30 ± 3.60 |
| 9 | Claude 4 Sonnet | 42.70 ± 3.59 |
| 10 | GPT-5 (high) | 41.78 ± 3.49 |
| 11 | GPT-5.2 Codex | 41.04 ± 3.57 |
| 12 | Claude 4.5 Haiku | 39.45 ± 3.55 |
| 13 | Qwen3-Coder 480B | 38.70 ± 3.55 |
| 14 | MiniMax 2.1 | 36.81 ± 3.55 |
| 15 | Gemini 3 Flash | 34.63 ± 3.55 |
Source: Scale AI SWE-Bench Pro public leaderboard, read October 15, 2026. Confidence intervals are Scale's; adjacent rows overlap.
The gap between the two benchmarks is the useful part. A model at 70% on Verified can sit near 40% on Pro. If your work looks like long multi-file changes in a codebase the model has never seen, Pro is the closer match. Scale also notes that Go and Python tasks resolve at higher rates than JavaScript and TypeScript ones, which matters if your codebase is the latter.
Older models people still search for
Searches for "SWE-bench scores for DeepSeek-Coder-V2, Qwen2.5-Coder, GPT-4o and Claude 3.5 Sonnet" still arrive at this page. Here is what is actually published for that generation.
| Model | Benchmark | Score | Who published it |
|---|---|---|---|
| Claude 3.5 Sonnet (upgraded, Oct 2024) | SWE-bench Verified | 49.0% | Anthropic's announcement; previous version 33.4% |
| GPT-4o | SWE-bench Verified | OpenAI's post returned an error when checked; not quoted | |
| DeepSeek-Coder-V2 236B Instruct | SWE-bench (original) | 12.7 | DeepSeek's README |
| DeepSeek-Coder-V2 16B Lite Instruct | SWE-bench (original) | 0.0 | DeepSeek's README |
| DeepSeek-Coder-V2 236B / 16B | HumanEval | 90.2 / 81.1 | DeepSeek's README |
| Qwen2.5-Coder 32B | SWE-bench Verified | 9.0 | swebench.com |
| Qwen3-Coder 480B | SWE-Bench Pro | 38.70 | Scale |
| gpt-oss-120b | SWE-bench Verified | 26.0 | swebench.com |
Sources: Anthropic, DeepSeek-Coder-V2 README, swebench.com, Scale. DeepSeek's paper (arXiv) gives the model 338 languages and a 128K context.
Two cautions. HumanEval is a 164-problem function-completion test that current models saturate, which is why no current board uses it; a 90% HumanEval score says nothing about repository-scale work, as the same model's 12.7 on SWE-bench shows. And Claude 3.5 Sonnet's 49.0% was the state of the art two years ago; the current board's leader is 27 points higher. Searches for "Mistral Medium 3.5 SWE-bench" also arrive here; Mistral's model has no row on the official Verified board, so we quote nothing for it, and our Mistral Medium 3.5 page carries the vendor's own figures with that caveat.
Local AI model ranking: open-weight coders you can run
These are the open-weight coding models with a working Ollama tag, ordered by the best published agentic-coding score. The "published score" column says who published it, because the difference matters: a number on a model card was measured by the people who built the model, with their own agent setup.
| Rank | Model | Ollama tag | Download | Licence | Published score |
|---|---|---|---|---|---|
| 1 | Qwen3.8 27B | qwen3.8:27b | 18GB | Apache 2.0 | SWE-bench Pro 61.7, Terminal-Bench 2.1 73.0 (Qwen model card) |
| 2 | Qwen3.6 27B | qwen3.6:27b | 18GB | Apache 2.0 | SWE-bench Verified 77.2, Multilingual 71.3, Pro 53.5 (Qwen model card) |
| 3 | Devstral 2 123B | devstral-2:123b | 75GB | see model card | SWE-bench Verified 72.2% (Mistral); 53.8 on swebench.com |
| 4 | Devstral Small 2 24B | devstral-small-2:24b | 15GB | Apache 2.0 | SWE-bench Verified 68.0%, Multilingual 55.7% (Mistral); 56.4 on swebench.com |
| 5 | Qwen3-Coder 30B | qwen3-coder:30b | 19GB | Apache 2.0 | 51.6 on swebench.com (inside the OpenHands agent) |
| 6 | Qwen3-Coder-Next | qwen3-coder-next | 52GB | Apache 2.0 | No numeric score in the card text |
| 7 | gpt-oss 20B | gpt-oss:20b | 14GB | Apache 2.0 | None for the 20B; gpt-oss-120b scores 26.0 on swebench.com |
| 8 | Qwen2.5-Coder 32B | qwen2.5-coder:32b | 20GB | Apache 2.0 | 9.0 on swebench.com |
| — | Qwen2.5-Coder 14B / 7B | qwen2.5-coder:14b / :7b | 9.0GB / 4.7GB | see model card | None; completion and chat on small cards |
| — | DeepSeek-Coder-V2 16B | deepseek-coder-v2:16b | 8.9GB | see model card | 0.0 on original SWE-bench (DeepSeek README) |
| — | Codestral 22B | codestral:22b | 13GB | see model card | None |
Sources: tag names and download sizes from each model's Ollama tags page (re-read October 15, 2026); licence and parameter counts from the Hugging Face model cards; leaderboard rows from swebench.com. Unranked rows have no agentic score to rank on.
What each one needs and when to pick it:
- Qwen3.8 27B is the newest release in this list: 27B parameters, 262,144-token native context, and image input. The 18GB download is a 24GB-GPU model. Qwen's card compares it with its own predecessor on SWE-bench Pro (61.7 against 53.5 for Qwen3.6 27B), measured by Qwen with the Claude Code harness. It is a general model, not a code-only one. Our page on Qwen3.8 27B covers the smaller quantizations.
- Qwen3.6 27B has the fullest published coding results of any model this size: 77.2 on SWE-bench Verified, 71.3 on SWE-bench Multilingual and 53.5 on SWE-bench Pro, all self-reported by Qwen using an internal agent. Same 18GB download, same 24GB-GPU class.
- Devstral Small 2 24B is the one to read carefully. Mistral's model card reports 68.0% on SWE-bench Verified; the official leaderboard lists the same model at 56.4%. Both can be true, since the harness differs. Mistral says it runs on a single RTX 4090 or a Mac with 32GB of memory. Details in our Devstral guide.
- Devstral 2 123B is a 75GB download at 4-bit. That is workstation or multi-GPU hardware, not a desktop card.
- Qwen3-Coder 30B is a mixture-of-experts model: 30.5B parameters in total, 3.3B active per token, 262,144-token native context, with tool calling built in. The 19GB download fits a 24GB GPU. See Qwen3-Coder.
- Qwen3-Coder-Next has 80B parameters in total with 3B active per token. Only a small part of the network runs for each token, but all of it has to be loaded: the smallest Ollama build is 52GB. Earlier versions of this page said it ran in 8GB of memory. That was wrong.
- gpt-oss 20B is OpenAI's open-weight model with 21B parameters, 3.6B of them active. OpenAI's card says it runs within 16GB of memory, which makes it the largest model here that fits a 16GB card with a little room left. See gpt-oss.
- Qwen2.5-Coder is the older generation and scores poorly as an autonomous agent (9.0% on the official board for the 32B). It is still a sensible choice for inline completion and chat on small hardware, because it ships in sizes nothing newer does:
qwen2.5-coder:7bis 4.7GB andqwen2.5-coder:14bis 9.0GB. See Qwen2.5-Coder 14B and the best 14B coding models.
Older models you may still see recommended. Code Llama (codellama:7b to codellama:70b, 3.8GB to 39GB) was trained on data up to January 2024; Meta's card for the 70B says that variant does not support the long 100K context. StarCoder2 15B (starcoder2:15b, 9.1GB) is a completion model, and its own card says instructions such as "write a function that..." do not work well. DeepSeek Coder 33B (deepseek-coder:33b, 19GB) has a 16K context. All three still run. None is a good first choice in 2026.
Picking by graphics card instead of by model? Use the VRAM guides: best coding model for 8GB, 12GB, 16GB, 24GB, or the full local AI coding models list. The MoE VRAM calculator handles the mixture-of-experts sizes.
Setup commands
# Pull and run a coding model (24GB GPU class)
ollama pull qwen3-coder:30b
ollama run qwen3-coder:30b
# 16GB card
ollama pull gpt-oss:20b
# 8GB card: completion and chat, not autonomous agents
ollama pull qwen2.5-coder:7b
Set the context length before you connect a coding agent. Ollama's documentation gives the defaults as 4K tokens under 24GB of VRAM, 32K from 24GB to 48GB, and 256K at 48GB and above. Four thousand tokens is not enough for an agent that reads files, and aider's documentation warns that Ollama "silently discards context that exceeds the window".
# Start the server with a larger context window
OLLAMA_CONTEXT_LENGTH=64000 ollama serve
# Check what is loaded and how much context it was given
ollama ps
A longer context uses more memory, so a model that fits at 4K may spill out of VRAM at 64K. Editor setup is covered in Continue.dev with Ollama.
Aider polyglot: a ranking across six languages
The Aider polyglot leaderboard scores models on 225 Exercism exercises in C++, Go, Java, JavaScript, Python and Rust, and publishes what each run cost. It was last updated on November 20, 2025, so it covers an older generation than the tables above. It is still the only board here that reports cost per run.
| Rank | Model | % correct | Cost of the run |
|---|---|---|---|
| 1 | GPT-5 (high) | 88.0 | $29.08 |
| 2 | GPT-5 (medium) | 86.7 | $17.69 |
| 3 | o3-pro (high) | 84.9 | $146.32 |
| 4 | Gemini 2.5 Pro preview 06-05 (32k think) | 83.1 | $49.88 |
| 5 | GPT-5 (low) | 81.3 | $10.37 |
| 5 | o3 (high) | 81.3 | $21.23 |
| 7 | Grok 4 (high) | 79.6 | $59.62 |
| 8 | Gemini 2.5 Pro preview 06-05 (default think) | 79.1 | $45.60 |
| 9 | o3 (high) + GPT-4.1 | 78.2 | $17.55 |
| 10 | o3 | 76.9 | $13.75 |
| — | DeepSeek V3.2-Exp (Reasoner) | 74.2 | $1.30 |
| — | Claude Opus 4 (32k thinking) | 72.0 | $65.75 |
Source: aider.chat leaderboard, read October 15, 2026.
The DeepSeek row is why this board is worth reading: 74.2% for $1.30, against 84.9% for $146.32 at the top. For everyday work the cheaper model is often the rational choice.
The coding benchmarks, explained in one table
"AI coding benchmark" and "coding leaderboard" searches usually want to know which board to trust for which question. None of them is wrong; they measure different things.
| Benchmark | Maintainer | What it measures | Languages | Tasks | Last updated |
|---|---|---|---|---|---|
| SWE-bench Verified | SWE-bench team | Fix a real GitHub issue so tests pass, bare agent | Python | 500 | Feb 26, 2026 |
| SWE-bench Multilingual | SWE-bench team | Same task, nine languages | C, C++, Go, Java, JS, TS, PHP, Ruby, Rust | 300 | Feb 20, 2026 |
| SWE-Bench Pro (public) | Scale AI | Longer, harder issues; contamination-resistant | Python, Go, JS, TS | 731 | Live; read Oct 15, 2026 |
| Aider polyglot | Aider | Exercism exercises via the aider editing loop; reports cost | C++, Go, Java, JS, Python, Rust | 225 | Nov 20, 2025 |
| Terminal-Bench | vendors quote it | Agent tasks in a terminal | mixed | varies by version | vendor cards (Qwen, Mistral, Anthropic) |
| LiveCodeBench | LiveCodeBench | Contest-style problems, continuously refreshed | Python | rolling | Board did not load when checked |
| HumanEval | OpenAI (2021) | Complete a function from a docstring | Python | 164 | Saturated; no longer used by current boards |
Sources linked in the sections above. Terminal-Bench and LiveCodeBench figures on this page come only from vendor model cards (Qwen3.6 27B: Terminal-Bench 2.0 59.3, LiveCodeBench v6 83.9; Qwen3.8 27B: Terminal-Bench 2.1 73.0, LiveCodeBench v6 90.3; Devstral Small 2: Terminal Bench 2 22.5), and benchmark versions differ between cards, so they are not comparable across vendors.
How to use the table: for "can it fix bugs in a real repository", read Verified and Pro; for "does it handle my language", read Multilingual; for "what will it cost me", read Aider; and treat Terminal-Bench and LiveCodeBench numbers as vendor claims until an independent board lists them. More in SWE-bench explained and our AI benchmarks guide.
Ranking by programming language
No board scores current models per language, so there is no honest "best model for Rust" table. What exists is one published per-language breakdown on the SWE-bench Multilingual page: a single baseline run of Claude 3.7 Sonnet inside SWE-agent with a $2.50 cost cap, 43% resolved overall.
| Language | % resolved (one model, one harness) |
|---|---|
| Rust | 58.14 |
| Java | 53.49 |
| PHP | 48.84 |
| Ruby | 43.18 |
| JavaScript / TypeScript | 34.88 |
| Go | 30.95 |
| C / C++ | 28.57 |
Source: swebench.com/multilingual.html, read October 15, 2026.
The spread is the lesson: thirty points between the best and worst language for the same model. A model's headline Python score should not be assumed to carry over. Recommendation by language, with that caveat:
- Python. The Verified board at the top of this page is a Python ranking. Full detail on best AI models for Python development.
- JavaScript and TypeScript. Use Multilingual and Pro, both of which include them and both of which show JS/TS resolving at lower rates. Full detail on best AI for JavaScript and TypeScript.
- Go, Rust, Java, C++. Multilingual is the only board that covers them; Aider polyglot adds C++, Go, Java and Rust exercises. Within the Multilingual top ten the models are within six points of each other, so choose on price and tooling.
Editors, agents and assistants that run these models
The model is half the result; the tool that feeds it files and runs your tests is the other half.
| Tool | Where it runs | Models | Price (vendor page) | Local Ollama models |
|---|---|---|---|---|
| GitHub Copilot | VS Code, JetBrains, Visual Studio, Xcode, CLI | Several vendors' | Free (2,000 completions/mo); Pro $10; Pro+ $39; Max $100 | No |
| Cursor | Its own editor | Several vendors' | Free; Plus $8; Premium $30; Super $100; Ultra $200 | Via OpenAI-compatible endpoint; not the main path |
| Claude Code | Terminal | Claude | Usage-based or Claude subscription | Not natively; offline guide |
| Codex CLI | Terminal | OpenAI | OpenAI account | Yes; guide |
| Continue.dev | VS Code, JetBrains, CLI | Any; open source | Free | Yes, first-class |
| aider | Terminal | Any; open source | Free | Yes; guide |
| OpenCode, Cline, Kilo Code, Zed | Terminal or editor | Any, including local | Free | Yes; see OpenCode, Cline, Zed |
Prices from GitHub and Cursor, read October 15, 2026; plans carry monthly request or credit allowances.
The split that matters is assistant versus agent. Completions and chat (Copilot's default, Continue's autocomplete, Cursor's tab) suggest code as you type. Agents (Claude Code, Codex CLI, aider, Cursor's and Continue's agent modes, OpenCode, Cline) read the repository, edit files and run commands, which is what every SWE-bench variant measures and why the same model scores differently in different harnesses. Compared in Cursor vs Copilot vs Claude Code and best AI coding tools; for the open-source agent harnesses behind the leaderboards, see OpenHands vs SWE-agent.
Coding model comparison: how to choose
This section is opinion. It is based on the published numbers and prices above, not on measurements of our own.
- You want the strongest model and the bill is secondary. Start with Claude Opus 5.5 or GPT-6 Astra. Both vendors position them for long agentic coding work. Opus 5.5 costs less than half as much per token, and Anthropic's own advice is to reach for Fable 5.1 only when Opus at higher effort still falls short.
- You code all day and pay per token. Claude Sonnet 5.5, GPT-6.1 Sol and Gemini 4 Argon are all $2 / $10 right now. Gemini 3.8 Flash is cheaper still until the end of 2026.
- Bulk, low-difficulty edits. GPT-6 Luna and Claude Haiku 5.5 at $0.10 / $0.50.
- Your code cannot leave your machine. With a 24GB GPU, Qwen3.6 27B, Qwen3.8 27B or Qwen3-Coder 30B. With 16GB, gpt-oss 20B or Devstral Small 2. With 8GB, Qwen2.5-Coder 7B for completion, and a cloud model for anything that needs an agent. See the local AI privacy guide.
- A data science or notebook workflow. Pick the tool that can execute code before you pick the model; the Python page covers notebooks.
- You are comparing two models a point apart. Stop comparing scores and try both on a task from your own repository. That tells you more than any leaderboard.
To match a task to a model and budget, use the coding model router.
Frequently asked questions
Which GPT model is best for coding?
OpenAI's documentation names GPT-6 Astra as its most capable model and GPT-6.1 Sol as near-Astra performance at $2 / $10 per million tokens. On the official SWE-bench Verified board the newest OpenAI entries are GPT 5.2 and GPT 5.2 Codex, both at 72.8%; on SWE-Bench Pro, GPT-5.4 sits second at 59.10.
Which Claude model ranks highest for coding?
On the official board, Claude 4.5 Opus (76.8%) and Claude 4.6 Opus (75.6%). The current models are Claude Fable 5.1, Opus 5.5, Sonnet 5.5 and Haiku 5.5, which have no leaderboard entry yet; Anthropic recommends starting with Opus 5.5. The per-vendor table lists every Claude model with its score.
Which Google model is best for coding?
Google describes Gemini 3.8 Flash as built for long-horizon software engineering and Gemini 4 Argon as its flagship. On the official board, Gemini 3 Flash scores 75.8% and Gemini 3 Pro 69.6%, so the cheaper model ranks above the larger one there.
Can a local model match a cloud model?
On published numbers, the best open-weight models are close to where cloud models were a year earlier. Qwen reports 77.2% on SWE-bench Verified for Qwen3.6 27B. That figure is self-reported, and the one open-weight model with both a vendor score and an official leaderboard score (Devstral Small 2) shows a gap of more than eleven points between them. Expect a local model to handle routine edits well and to need more supervision on long tasks.
What is the best open-source coding model on Hugging Face?
By published agentic scores, Qwen3.8 27B and Qwen3.6 27B (Apache 2.0), with Devstral Small 2 (Apache 2.0) the strongest option that fits a 16GB to 24GB card and has an official-board row. All three are on Hugging Face and have Ollama tags; see the local ranking.
Why do different sites show different SWE-bench scores for the same model?
Because the score depends on the agent wrapped around the model as much as on the model. The same Claude 4.5 Opus appears on swebench.com at 76.8% with a minimal agent and 79.2% inside a custom one. Always check which harness a number came from.
How often does this ranking change?
The official leaderboard is updated in batches, not continuously; its newest entry is from February 26, 2026. Vendors release models faster than that. This page is updated when either the boards or the vendor price lists change.
Picked your coding model? Build a real AI dev workflow.
From local copilots to agents that ship code — the structured path, running on your hardware. First chapter free.
Liked this? 25 full AI courses are waiting.
From fundamentals to RAG, agents, MCP servers, voice AI, and production deployment with real GitHub repos. First chapter free, every course.
Build Real AI on Your Machine
RAG, agents, NLP, vision, and MLOps - chapters across 25 courses that take you from reading about AI to building AI.
Want the structured version?
Hands-on courses on local AI, from $8.99 a month. The first chapter of each is free.
Keep going
- PILLARBest Local AI for Coding 2026: 10 Models Ranked by VRAM
- 7B vs 14B vs 32B vs 70B for Coding (2026): What Size?
- AI Context Windows: 4K vs 128K vs 1M Tokens Explained (2026)
- Aider + Ollama Setup (2026): Free Local AI Coding Agent
- Best 14B Coding Models (2026): Ranked by HumanEval + VRAM
- Best Claude Model for Coding: Sonnet 5, Opus 4.8, Fable 5
- Best Ollama Model for Coding: Picks by VRAM Tier
- ChatGPT vs Claude vs Gemini Coding: Which Wins (2026)
- Claude 4 Sonnet for Coding: Is It Worth $20/mo? (77.2% SWE-bench)
- Claude Opus 4.8 Review: 88.6% SWE-Bench (2026)
Comments (0)
No comments yet. Be the first to share your thoughts!
