★ Reading this for free? Get 25 structured AI courses + per-chapter AI tutor — the first chapter of every course free, no card.Start free in 30 secondsOr own every course: $149 once
AI Models

Best AI Coding Models 2026: Top 12 Ranked on SWE-Bench

October 15, 2026
16 min read
Barsha Mohapatra

Want to go deeper than this article?

Free account unlocks the first chapter of all 25 courses — RAG, agents, MCP, voice AI, MLOps, real GitHub repos.

📚AI Learning Path

Picked your coding model? Build a real AI dev workflow. From local copilots to agents that ship code — the structured path, running on your hardware. First chapter free.

Start free
Or own it for life — Lifetime $149, pay once

Last updated October 15, 2026. Every figure below is quoted from a public leaderboard or a vendor's own documentation, with the link next to it. This site did not run any of these benchmarks. Sections marked as recommendation are editorial judgment.

Quick answer: which AI coding model ranks first?

On the official SWE-bench Verified leaderboard, the highest score in the like-for-like comparison (every model driven by the same minimal agent, mini-SWE-agent 2.0) is Claude 4.5 Opus at 76.8%, followed by Gemini 3 Flash and MiniMax M2.5 at 75.8% and Claude 4.6 Opus at 75.6%. That board was last updated on February 26, 2026, so it does not yet include the models the three big vendors sell today: Claude Opus 5.5 and Fable 5.1, GPT-6 Astra, Gemini 4 Argon and Gemini 3.8 Flash.

So the honest answer has two parts. The ranking below is the newest independent one that exists. The model to actually use is usually the current successor of whatever ranks well, and the per-vendor section lists those with their real prices. If you want to run a model on your own machine instead, skip to the local ranking.

Reading articles is good. Building is better.

Free account = the first chapter of all 25 courses, with a per-chapter AI tutor. No card.

SWE-bench Verified ranking: the top 12

SWE-bench Verified is a human-filtered set of 500 real GitHub issues. A model is given the repository and the issue text and has to produce a patch that makes the project's tests pass. The rows below all use the leaderboard's bash-only setting: one simple agent loop, no custom tooling, so the difference between rows is the model and not the scaffolding around it.

RankModel% resolvedMakerEntry date
1Claude 4.5 Opus (high)76.8Anthropic2026-02-17
2Gemini 3 Flash (high)75.8Google2026-02-17
2MiniMax M2.5 (high)75.8MiniMax2026-02-17
4Claude 4.6 Opus75.6Anthropic2026-02-17
5GLM 5 (high)72.8Z.ai2026-02-17
5GPT 5.2 (high)72.8OpenAI2026-02-17
5GPT 5.2 Codex72.8OpenAI2026-02-19
8Claude 4.5 Sonnet (high)71.4Anthropic2026-02-17
9Kimi K2.5 (high)70.8Moonshot AI2026-02-17
10DeepSeek V3.2 (high)70.0DeepSeek2026-02-17
11Gemini 3 Pro69.6Google2026-02-26
12Claude 4.5 Haiku (high)66.6Anthropic2026-02-17

Source: swebench.com, Verified board, mini-SWE-agent 2.0.0 entries, read on September 29, 2026. The board renders its rows with JavaScript and had no newer entries when re-checked on October 15, 2026.

Three things to take from it:

  • The top four are inside 1.2 points of each other. With 500 tasks, one point is five issues. Do not choose between those models on this number.
  • Custom agents score higher than the bare model. The same board lists Claude 4.5 Opus at 79.2% inside two third-party agent systems. When a vendor quotes a bigger number than the table above, it is usually a different harness, not a different model.
  • SWE-bench is a Python benchmark. The original dataset is 2,294 problems from 12 Python repositories (paper), and Verified is a subset of it. It says little about how a model handles TypeScript, Go or Rust. For those, see the per-language section below.

For a longer explanation of how the benchmark is built and where it misleads, see SWE-bench explained.

Current models the leaderboard has not scored yet

Every model in the ranking above has since been replaced or joined by a newer one. These are the models the vendors list as current, with the prices and limits from their own documentation. None of them has an entry on the official SWE-bench Verified board yet, so this table has no score column.

ModelMakerInput / output per 1M tokensContext windowHow the vendor describes it
Claude Fable 5.1Anthropic$10 / $501MDemanding reasoning and long-horizon agentic work
Claude Opus 5.5Anthropic$4 / $201MLong-running agentic coding and knowledge work
Claude Sonnet 5.5Anthropic$2 / $101MBest combination of speed and intelligence
Claude Haiku 5.5Anthropicfrom $0.10 / $0.501MHigh-volume, latency-sensitive tasks
GPT-6 AstraOpenAI$10 / $501.05MMost capable model for the most demanding work
GPT-6.1 SolOpenAI$2 / $101.05MNear-Astra performance for complex work at a lower cost
GPT-6 LunaOpenAI$0.10 / $0.501.05MMost efficient model for focused, high-volume tasks
Gemini 4 ArgonGoogle$2 / $10 until Nov 30, 2026, then $4 / $201MFlagship reasoning model
Gemini 3.8 FlashGoogle$0.75 / $3.75 until Dec 31, 2026, then $1.50 / $7.501M in, 65,536 outLong-horizon software engineering and agents

Sources: Anthropic models overview and pricing; OpenAI models and pricing (short-context standard rates); Gemini API pricing and models. Read on October 15, 2026. Prices change, so check the vendor page before you budget.

Anthropic released Claude Opus 5.5 on September 22, 2026. Its announcement reports 66.4% on Terminal-Bench 4.0, against 57.9% for GPT-6 Astra and 52.3% for the previous Claude Opus 5. That is a vendor's own measurement of its own model, published in a launch post. Treat it as a claim to be checked, not as an independent ranking.

Older models named on earlier versions of this page have been superseded: Claude 4 Sonnet and Claude Opus 4 are retired on Anthropic's API, GPT-5.5 is now listed by OpenAI as a previous-generation model at $5 / $30, and Google lists Gemini 3.1 Pro Preview as shut down.

Ranked by vendor: Claude, GPT and Gemini models for coding

Most searches that land here ask a narrower question: which Claude, which GPT, or which Gemini. Each table lists the vendor's current and still-available models with the official-board score where one exists. A blank cell means no entry on swebench.com.

Which Claude model is best for coding?

ModelStatus (Anthropic)Price per 1MSWE-bench Verified (official board)
Claude Fable 5.1Current; "demanding reasoning and long-horizon agentic work"$10 / $50
Claude Opus 5.5Current; recommended starting point "for most workloads"$4 / $20
Claude Sonnet 5.5Current$2 / $10
Claude Haiku 5.5Currentfrom $0.10 / $0.50
Claude Opus 4.6Legacy, still availablesee pricing page75.6
Claude Opus 4.5Legacy, still availablesee pricing page76.8
Claude Sonnet 4.6 / Sonnet 5Legacy, still availablesee pricing page
Claude 4.5 SonnetRetired on the API71.4
Claude 4.5 HaikuLegacy, still availablesee pricing page66.6
Claude 3.5 Sonnet (Oct 2024)Retired49.0 (Anthropic's announcement, not the current board)

Sources: Anthropic models overview (status and prices, read October 15, 2026); swebench.com (scores); Anthropic, October 22, 2024 for the 3.5 Sonnet figure.

Recommendation: Anthropic's own documentation says to start with Opus 5.5 and move to Fable 5.1 only when Opus "at higher effort" still falls short. For routine work Sonnet 5.5 is the price-sensible pick. The highest Claude score on the independent board belongs to a previous generation (4.5 Opus, 76.8%), which is a statement about the board's age rather than the models. The Claude model guide goes tier by tier, and the Claude Code offline guide covers running the agent against a local model.

Which GPT model is best for coding?

ModelStatus (OpenAI)Price per 1MIndependent score
GPT-6 AstraCurrent; "most capable model for the most demanding work"$10 / $50
GPT-6.1 SolCurrent; "near-Astra performance … at a lower cost"$2 / $10
GPT-6 SolCurrent$2 / $10
GPT-6 LunaCurrent; "focused, high-volume tasks"$0.10 / $0.50
GPT-5.6 Sol / Terra / LunaPrevious generation$4 / $20; $2 / $12; $0.20 / $1.20
GPT-5.5Previous generation$5 / $30
GPT-5.4Previous generation$2.50 / $1559.10 on SWE-Bench Pro (Scale)
GPT 5.2 / 5.2 CodexNot on the current price list72.8 Verified (official board)
GPT-5Previous generation$1.25 / $1088.0% Aider polyglot (high); 41.78 SWE-Bench Pro
GPT-4oPrevious generation$2.50 / $10OpenAI's Verified post was unreachable when checked; not quoted

Sources: OpenAI pricing and models, read October 15, 2026; swebench.com; Scale SWE-Bench Pro; Aider.

Recommendation: GPT-6.1 Sol for daily work, GPT-6 Astra for the hardest multi-file jobs, GPT-6 Luna for bulk edits. OpenAI lists no dedicated Codex model in the current catalogue; the general models power Codex CLI, which can also be pointed at a local model (guide). Our GPT-5.5 page covers the previous flagship.

Which Google model is best for coding?

ModelStatus (Google)Price per 1MSWE-bench Verified (official board)
Gemini 4 ArgonCurrent flagship reasoning model$2 / $10 until Nov 30, 2026, then $4 / $20
Gemini 3.8 FlashCurrent; "long-horizon software engineering, autonomous agents"$0.75 / $3.75 until Dec 31, 2026
Gemini 3.6 FlashPrevious generation$0.75 / $3.75 until Dec 31, 2026
Gemini 3 FlashNot on the current price list75.8
Gemini 3 ProNot on the current price list69.6
Gemini 3.1 Pro PreviewShut down46.10 on SWE-Bench Pro (Scale)
Gemini 2.5 ProLegacy$1.25 / $10 up to 200K83.1% Aider polyglot (06-05 preview, 32k think)

Sources: Gemini pricing and models, read October 15, 2026; swebench.com; Scale; Aider.

Recommendation: Gemini 3.8 Flash is the value pick while its promotional price lasts, and Google's own description aims it at software engineering. On the official board the cheaper Gemini 3 Flash outscored Gemini 3 Pro, so do not assume the larger model is the better coder. For a three-way comparison of the chat products, see ChatGPT vs Claude vs Gemini for coding.

Own it instead of renting it

Run this on your own machine and stop paying every month

Pay once and keep it. No renewal, no per-token bill, and nothing you feed it ever leaves your hardware.

SWE-Bench Pro: the harder, multi-language ranking

SWE-Bench Pro, run by Scale AI, covers Python, Go, JavaScript and TypeScript; the public set has 731 instances. Scores are much lower than on Verified, which is the point: the tasks are longer and less likely to have leaked into training data.

RankModelScore (public set)
1Muse Spark 1.161.50 ± 3.10
2GPT-5.4 (xHigh)59.10 ± 3.56
3Muse Spark55.00 ± 3.60
4Claude Opus 4.6 (thinking)51.90 ± 3.61
5Gemini 3.1 Pro (thinking)46.10 ± 3.60
6Claude Opus 4.545.89 ± 3.60
7Claude 4.5 Sonnet43.60 ± 3.60
8Gemini 3 Pro preview43.30 ± 3.60
9Claude 4 Sonnet42.70 ± 3.59
10GPT-5 (high)41.78 ± 3.49
11GPT-5.2 Codex41.04 ± 3.57
12Claude 4.5 Haiku39.45 ± 3.55
13Qwen3-Coder 480B38.70 ± 3.55
14MiniMax 2.136.81 ± 3.55
15Gemini 3 Flash34.63 ± 3.55

Source: Scale AI SWE-Bench Pro public leaderboard, read October 15, 2026. Confidence intervals are Scale's; adjacent rows overlap.

The gap between the two benchmarks is the useful part. A model at 70% on Verified can sit near 40% on Pro. If your work looks like long multi-file changes in a codebase the model has never seen, Pro is the closer match. Scale also notes that Go and Python tasks resolve at higher rates than JavaScript and TypeScript ones, which matters if your codebase is the latter.

Older models people still search for

Searches for "SWE-bench scores for DeepSeek-Coder-V2, Qwen2.5-Coder, GPT-4o and Claude 3.5 Sonnet" still arrive at this page. Here is what is actually published for that generation.

ModelBenchmarkScoreWho published it
Claude 3.5 Sonnet (upgraded, Oct 2024)SWE-bench Verified49.0%Anthropic's announcement; previous version 33.4%
GPT-4oSWE-bench VerifiedOpenAI's post returned an error when checked; not quoted
DeepSeek-Coder-V2 236B InstructSWE-bench (original)12.7DeepSeek's README
DeepSeek-Coder-V2 16B Lite InstructSWE-bench (original)0.0DeepSeek's README
DeepSeek-Coder-V2 236B / 16BHumanEval90.2 / 81.1DeepSeek's README
Qwen2.5-Coder 32BSWE-bench Verified9.0swebench.com
Qwen3-Coder 480BSWE-Bench Pro38.70Scale
gpt-oss-120bSWE-bench Verified26.0swebench.com

Sources: Anthropic, DeepSeek-Coder-V2 README, swebench.com, Scale. DeepSeek's paper (arXiv) gives the model 338 languages and a 128K context.

Two cautions. HumanEval is a 164-problem function-completion test that current models saturate, which is why no current board uses it; a 90% HumanEval score says nothing about repository-scale work, as the same model's 12.7 on SWE-bench shows. And Claude 3.5 Sonnet's 49.0% was the state of the art two years ago; the current board's leader is 27 points higher. Searches for "Mistral Medium 3.5 SWE-bench" also arrive here; Mistral's model has no row on the official Verified board, so we quote nothing for it, and our Mistral Medium 3.5 page carries the vendor's own figures with that caveat.

Local AI model ranking: open-weight coders you can run

These are the open-weight coding models with a working Ollama tag, ordered by the best published agentic-coding score. The "published score" column says who published it, because the difference matters: a number on a model card was measured by the people who built the model, with their own agent setup.

RankModelOllama tagDownloadLicencePublished score
1Qwen3.8 27Bqwen3.8:27b18GBApache 2.0SWE-bench Pro 61.7, Terminal-Bench 2.1 73.0 (Qwen model card)
2Qwen3.6 27Bqwen3.6:27b18GBApache 2.0SWE-bench Verified 77.2, Multilingual 71.3, Pro 53.5 (Qwen model card)
3Devstral 2 123Bdevstral-2:123b75GBsee model cardSWE-bench Verified 72.2% (Mistral); 53.8 on swebench.com
4Devstral Small 2 24Bdevstral-small-2:24b15GBApache 2.0SWE-bench Verified 68.0%, Multilingual 55.7% (Mistral); 56.4 on swebench.com
5Qwen3-Coder 30Bqwen3-coder:30b19GBApache 2.051.6 on swebench.com (inside the OpenHands agent)
6Qwen3-Coder-Nextqwen3-coder-next52GBApache 2.0No numeric score in the card text
7gpt-oss 20Bgpt-oss:20b14GBApache 2.0None for the 20B; gpt-oss-120b scores 26.0 on swebench.com
8Qwen2.5-Coder 32Bqwen2.5-coder:32b20GBApache 2.09.0 on swebench.com
—Qwen2.5-Coder 14B / 7Bqwen2.5-coder:14b / :7b9.0GB / 4.7GBsee model cardNone; completion and chat on small cards
—DeepSeek-Coder-V2 16Bdeepseek-coder-v2:16b8.9GBsee model card0.0 on original SWE-bench (DeepSeek README)
—Codestral 22Bcodestral:22b13GBsee model cardNone

Sources: tag names and download sizes from each model's Ollama tags page (re-read October 15, 2026); licence and parameter counts from the Hugging Face model cards; leaderboard rows from swebench.com. Unranked rows have no agentic score to rank on.

What each one needs and when to pick it:

  • Qwen3.8 27B is the newest release in this list: 27B parameters, 262,144-token native context, and image input. The 18GB download is a 24GB-GPU model. Qwen's card compares it with its own predecessor on SWE-bench Pro (61.7 against 53.5 for Qwen3.6 27B), measured by Qwen with the Claude Code harness. It is a general model, not a code-only one. Our page on Qwen3.8 27B covers the smaller quantizations.
  • Qwen3.6 27B has the fullest published coding results of any model this size: 77.2 on SWE-bench Verified, 71.3 on SWE-bench Multilingual and 53.5 on SWE-bench Pro, all self-reported by Qwen using an internal agent. Same 18GB download, same 24GB-GPU class.
  • Devstral Small 2 24B is the one to read carefully. Mistral's model card reports 68.0% on SWE-bench Verified; the official leaderboard lists the same model at 56.4%. Both can be true, since the harness differs. Mistral says it runs on a single RTX 4090 or a Mac with 32GB of memory. Details in our Devstral guide.
  • Devstral 2 123B is a 75GB download at 4-bit. That is workstation or multi-GPU hardware, not a desktop card.
  • Qwen3-Coder 30B is a mixture-of-experts model: 30.5B parameters in total, 3.3B active per token, 262,144-token native context, with tool calling built in. The 19GB download fits a 24GB GPU. See Qwen3-Coder.
  • Qwen3-Coder-Next has 80B parameters in total with 3B active per token. Only a small part of the network runs for each token, but all of it has to be loaded: the smallest Ollama build is 52GB. Earlier versions of this page said it ran in 8GB of memory. That was wrong.
  • gpt-oss 20B is OpenAI's open-weight model with 21B parameters, 3.6B of them active. OpenAI's card says it runs within 16GB of memory, which makes it the largest model here that fits a 16GB card with a little room left. See gpt-oss.
  • Qwen2.5-Coder is the older generation and scores poorly as an autonomous agent (9.0% on the official board for the 32B). It is still a sensible choice for inline completion and chat on small hardware, because it ships in sizes nothing newer does: qwen2.5-coder:7b is 4.7GB and qwen2.5-coder:14b is 9.0GB. See Qwen2.5-Coder 14B and the best 14B coding models.

Older models you may still see recommended. Code Llama (codellama:7b to codellama:70b, 3.8GB to 39GB) was trained on data up to January 2024; Meta's card for the 70B says that variant does not support the long 100K context. StarCoder2 15B (starcoder2:15b, 9.1GB) is a completion model, and its own card says instructions such as "write a function that..." do not work well. DeepSeek Coder 33B (deepseek-coder:33b, 19GB) has a 16K context. All three still run. None is a good first choice in 2026.

Picking by graphics card instead of by model? Use the VRAM guides: best coding model for 8GB, 12GB, 16GB, 24GB, or the full local AI coding models list. The MoE VRAM calculator handles the mixture-of-experts sizes.

Setup commands

# Pull and run a coding model (24GB GPU class)
ollama pull qwen3-coder:30b
ollama run qwen3-coder:30b

# 16GB card
ollama pull gpt-oss:20b

# 8GB card: completion and chat, not autonomous agents
ollama pull qwen2.5-coder:7b

Set the context length before you connect a coding agent. Ollama's documentation gives the defaults as 4K tokens under 24GB of VRAM, 32K from 24GB to 48GB, and 256K at 48GB and above. Four thousand tokens is not enough for an agent that reads files, and aider's documentation warns that Ollama "silently discards context that exceeds the window".

# Start the server with a larger context window
OLLAMA_CONTEXT_LENGTH=64000 ollama serve

# Check what is loaded and how much context it was given
ollama ps

A longer context uses more memory, so a model that fits at 4K may spill out of VRAM at 64K. Editor setup is covered in Continue.dev with Ollama.

Aider polyglot: a ranking across six languages

The Aider polyglot leaderboard scores models on 225 Exercism exercises in C++, Go, Java, JavaScript, Python and Rust, and publishes what each run cost. It was last updated on November 20, 2025, so it covers an older generation than the tables above. It is still the only board here that reports cost per run.

RankModel% correctCost of the run
1GPT-5 (high)88.0$29.08
2GPT-5 (medium)86.7$17.69
3o3-pro (high)84.9$146.32
4Gemini 2.5 Pro preview 06-05 (32k think)83.1$49.88
5GPT-5 (low)81.3$10.37
5o3 (high)81.3$21.23
7Grok 4 (high)79.6$59.62
8Gemini 2.5 Pro preview 06-05 (default think)79.1$45.60
9o3 (high) + GPT-4.178.2$17.55
10o376.9$13.75
—DeepSeek V3.2-Exp (Reasoner)74.2$1.30
—Claude Opus 4 (32k thinking)72.0$65.75

Source: aider.chat leaderboard, read October 15, 2026.

The DeepSeek row is why this board is worth reading: 74.2% for $1.30, against 84.9% for $146.32 at the top. For everyday work the cheaper model is often the rational choice.

The coding benchmarks, explained in one table

"AI coding benchmark" and "coding leaderboard" searches usually want to know which board to trust for which question. None of them is wrong; they measure different things.

BenchmarkMaintainerWhat it measuresLanguagesTasksLast updated
SWE-bench VerifiedSWE-bench teamFix a real GitHub issue so tests pass, bare agentPython500Feb 26, 2026
SWE-bench MultilingualSWE-bench teamSame task, nine languagesC, C++, Go, Java, JS, TS, PHP, Ruby, Rust300Feb 20, 2026
SWE-Bench Pro (public)Scale AILonger, harder issues; contamination-resistantPython, Go, JS, TS731Live; read Oct 15, 2026
Aider polyglotAiderExercism exercises via the aider editing loop; reports costC++, Go, Java, JS, Python, Rust225Nov 20, 2025
Terminal-Benchvendors quote itAgent tasks in a terminalmixedvaries by versionvendor cards (Qwen, Mistral, Anthropic)
LiveCodeBenchLiveCodeBenchContest-style problems, continuously refreshedPythonrollingBoard did not load when checked
HumanEvalOpenAI (2021)Complete a function from a docstringPython164Saturated; no longer used by current boards

Sources linked in the sections above. Terminal-Bench and LiveCodeBench figures on this page come only from vendor model cards (Qwen3.6 27B: Terminal-Bench 2.0 59.3, LiveCodeBench v6 83.9; Qwen3.8 27B: Terminal-Bench 2.1 73.0, LiveCodeBench v6 90.3; Devstral Small 2: Terminal Bench 2 22.5), and benchmark versions differ between cards, so they are not comparable across vendors.

How to use the table: for "can it fix bugs in a real repository", read Verified and Pro; for "does it handle my language", read Multilingual; for "what will it cost me", read Aider; and treat Terminal-Bench and LiveCodeBench numbers as vendor claims until an independent board lists them. More in SWE-bench explained and our AI benchmarks guide.

Ranking by programming language

No board scores current models per language, so there is no honest "best model for Rust" table. What exists is one published per-language breakdown on the SWE-bench Multilingual page: a single baseline run of Claude 3.7 Sonnet inside SWE-agent with a $2.50 cost cap, 43% resolved overall.

Language% resolved (one model, one harness)
Rust58.14
Java53.49
PHP48.84
Ruby43.18
JavaScript / TypeScript34.88
Go30.95
C / C++28.57

Source: swebench.com/multilingual.html, read October 15, 2026.

The spread is the lesson: thirty points between the best and worst language for the same model. A model's headline Python score should not be assumed to carry over. Recommendation by language, with that caveat:

  • Python. The Verified board at the top of this page is a Python ranking. Full detail on best AI models for Python development.
  • JavaScript and TypeScript. Use Multilingual and Pro, both of which include them and both of which show JS/TS resolving at lower rates. Full detail on best AI for JavaScript and TypeScript.
  • Go, Rust, Java, C++. Multilingual is the only board that covers them; Aider polyglot adds C++, Go, Java and Rust exercises. Within the Multilingual top ten the models are within six points of each other, so choose on price and tooling.

Editors, agents and assistants that run these models

The model is half the result; the tool that feeds it files and runs your tests is the other half.

ToolWhere it runsModelsPrice (vendor page)Local Ollama models
GitHub CopilotVS Code, JetBrains, Visual Studio, Xcode, CLISeveral vendors'Free (2,000 completions/mo); Pro $10; Pro+ $39; Max $100No
CursorIts own editorSeveral vendors'Free; Plus $8; Premium $30; Super $100; Ultra $200Via OpenAI-compatible endpoint; not the main path
Claude CodeTerminalClaudeUsage-based or Claude subscriptionNot natively; offline guide
Codex CLITerminalOpenAIOpenAI accountYes; guide
Continue.devVS Code, JetBrains, CLIAny; open sourceFreeYes, first-class
aiderTerminalAny; open sourceFreeYes; guide
OpenCode, Cline, Kilo Code, ZedTerminal or editorAny, including localFreeYes; see OpenCode, Cline, Zed

Prices from GitHub and Cursor, read October 15, 2026; plans carry monthly request or credit allowances.

The split that matters is assistant versus agent. Completions and chat (Copilot's default, Continue's autocomplete, Cursor's tab) suggest code as you type. Agents (Claude Code, Codex CLI, aider, Cursor's and Continue's agent modes, OpenCode, Cline) read the repository, edit files and run commands, which is what every SWE-bench variant measures and why the same model scores differently in different harnesses. Compared in Cursor vs Copilot vs Claude Code and best AI coding tools; for the open-source agent harnesses behind the leaderboards, see OpenHands vs SWE-agent.

Coding model comparison: how to choose

This section is opinion. It is based on the published numbers and prices above, not on measurements of our own.

  • You want the strongest model and the bill is secondary. Start with Claude Opus 5.5 or GPT-6 Astra. Both vendors position them for long agentic coding work. Opus 5.5 costs less than half as much per token, and Anthropic's own advice is to reach for Fable 5.1 only when Opus at higher effort still falls short.
  • You code all day and pay per token. Claude Sonnet 5.5, GPT-6.1 Sol and Gemini 4 Argon are all $2 / $10 right now. Gemini 3.8 Flash is cheaper still until the end of 2026.
  • Bulk, low-difficulty edits. GPT-6 Luna and Claude Haiku 5.5 at $0.10 / $0.50.
  • Your code cannot leave your machine. With a 24GB GPU, Qwen3.6 27B, Qwen3.8 27B or Qwen3-Coder 30B. With 16GB, gpt-oss 20B or Devstral Small 2. With 8GB, Qwen2.5-Coder 7B for completion, and a cloud model for anything that needs an agent. See the local AI privacy guide.
  • A data science or notebook workflow. Pick the tool that can execute code before you pick the model; the Python page covers notebooks.
  • You are comparing two models a point apart. Stop comparing scores and try both on a task from your own repository. That tells you more than any leaderboard.

To match a task to a model and budget, use the coding model router.

Frequently asked questions

Which GPT model is best for coding?

OpenAI's documentation names GPT-6 Astra as its most capable model and GPT-6.1 Sol as near-Astra performance at $2 / $10 per million tokens. On the official SWE-bench Verified board the newest OpenAI entries are GPT 5.2 and GPT 5.2 Codex, both at 72.8%; on SWE-Bench Pro, GPT-5.4 sits second at 59.10.

Which Claude model ranks highest for coding?

On the official board, Claude 4.5 Opus (76.8%) and Claude 4.6 Opus (75.6%). The current models are Claude Fable 5.1, Opus 5.5, Sonnet 5.5 and Haiku 5.5, which have no leaderboard entry yet; Anthropic recommends starting with Opus 5.5. The per-vendor table lists every Claude model with its score.

Which Google model is best for coding?

Google describes Gemini 3.8 Flash as built for long-horizon software engineering and Gemini 4 Argon as its flagship. On the official board, Gemini 3 Flash scores 75.8% and Gemini 3 Pro 69.6%, so the cheaper model ranks above the larger one there.

Can a local model match a cloud model?

On published numbers, the best open-weight models are close to where cloud models were a year earlier. Qwen reports 77.2% on SWE-bench Verified for Qwen3.6 27B. That figure is self-reported, and the one open-weight model with both a vendor score and an official leaderboard score (Devstral Small 2) shows a gap of more than eleven points between them. Expect a local model to handle routine edits well and to need more supervision on long tasks.

What is the best open-source coding model on Hugging Face?

By published agentic scores, Qwen3.8 27B and Qwen3.6 27B (Apache 2.0), with Devstral Small 2 (Apache 2.0) the strongest option that fits a 16GB to 24GB card and has an official-board row. All three are on Hugging Face and have Ollama tags; see the local ranking.

Why do different sites show different SWE-bench scores for the same model?

Because the score depends on the agent wrapped around the model as much as on the model. The same Claude 4.5 Opus appears on swebench.com at 76.8% with a minimal agent and 79.2% inside a custom one. Always check which harness a number came from.

How often does this ranking change?

The official leaderboard is updated in batches, not continuously; its newest entry is from February 26, 2026. Vendors release models faster than that. This page is updated when either the boards or the vendor price lists change.

🎯
AI Learning Path

Picked your coding model? Build a real AI dev workflow.

From local copilots to agents that ship code — the structured path, running on your hardware. First chapter free.

Or own it for life — Lifetime $149 $599, pay once

Liked this? 25 full AI courses are waiting.

From fundamentals to RAG, agents, MCP servers, voice AI, and production deployment with real GitHub repos. First chapter free, every course.

Reading now
Join the discussion
TagsAI ModelsCodingSWE-benchRankingsBenchmarksLocal AI

Barsha Mohapatra

Local AI Master writes hands-on courses and hardware guides for running AI on machines you own. Content is checked against current releases and corrected when readers tell us it is wrong.

Build Real AI on Your Machine

RAG, agents, NLP, vision, and MLOps - chapters across 25 courses that take you from reading about AI to building AI.

Want the structured version?

Hands-on courses on local AI, from $8.99 a month. The first chapter of each is free.

AI Learning Path
More on AI Models for Coding
See the full Best Local AI for Coding guide.

Comments (0)

No comments yet. Be the first to share your thoughts!

📅 Published: October 30, 2025🔄 Last Updated: October 15, 2026✓ Manually Reviewed
Barsha Mohapatra

Written by

Barsha Mohapatra

Founder and Editor, Local AI Master · Founder, Little AI Master

Founder of Little AI Master and the editor behind every course and guide on Local AI Master. Years of tutoring students taught her where AI education actually fails.

Related Guides

Continue your local AI journey with these comprehensive guides

See also on Local AI Master

Build Real AI on Your Machine

RAG, agents, NLP, vision, and MLOps - chapters across 25 courses that take you from reading about AI to building AI.

More on AI Models for Coding
See the full Best Local AI for Coding guide.
📚
Free · no account required

Grab the AI Starter Kit — career roadmap, cheat sheet, setup guide

No spam. Unsubscribe with one click.

🎯
AI Learning Path

Picked your coding model? Build a real AI dev workflow.

From local copilots to agents that ship code — the structured path, running on your hardware. First chapter free.

Or own it for life — Lifetime $149 $599, pay once
Free Tools & Calculators