UnifyBench

RankingSWE-bench Pro

SWE-bench Pro

Data updated 22 Oct 2026

Bucket
Coding
Unit
percent
Direction
Higher is better
Version
public
Display harness
SWE-bench Pro reported
Board
https://labs.scale.com/leaderboard/swe_bench_pro

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

276–300 of 471 entries

ModelScoreEvidenceSource-recorded date
MiniMax-M2.1MiniMax———
MiniMax-M2.5MiniMax———
MiniMax-M2.7MiniMax———
MiniMax-M3MiniMax———
MiniMax-M3.1-Flash-PreviewMiniMax———
MiniMax-Text-01MiniMax———
MiniMax-VL-01MiniMax———
Ministral 3 14BMistral———
Ministral 3 3BMistral———
Ministral 3 8BMistral———
Ministral 3BMistral———
Ministral 8BMistral———
Mistral Large 2 (July 2024)Mistral———
Mistral Large 2.1Mistral———
Mistral Large 3Mistral———
Mistral Large 4Mistral———
Mistral Medium 3Mistral———
Mistral Medium 3.1Mistral———
Mistral Medium 3.5Mistral———
Mistral Nemo 12BMistral———
Mistral Small 3.2Mistral———
Mistral Small 4Mistral———
Mistral Small CreativeMistral———
Muse Glimmer 30BMeta———
Muse Spark 1.2Meta———

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Claude Fable 5Anthropic80%Anthropic SWE-bench Pro reported systemlab self-report

Systemcard section8.2: SWEPro average overfive trials, adaptive max effort/defaultsampling. Agent equivalence to miniSWE is not documented; retain distinct reported-system harness, exclude preferred-agent aggregate.

2026-09-01
Claude Fable 5.1Anthropic81.2%Anthropic SWE-bench Pro reported systemlab self-report

Systemcard section8.2: SWEPro average overfive trials, adaptive max effort/defaultsampling. Agent equivalence to miniSWE is not documented; retain distinct reported-system harness, exclude preferred-agent aggregate.

2026-09-01