UnifyBench

RankingSWE-bench Pro

SWE-bench Pro

Data updated 22 Oct 2026

Bucket
Coding
Unit
percent
Direction
Higher is better
Version
public
Display harness
SWE-bench Pro reported
Board
https://labs.scale.com/leaderboard/swe_bench_pro

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

51–75 of 471 entries

ModelScoreEvidenceSource-recorded date
cogagent-vqa-hfZ.ai———
cogvlm-chat-hfZ.ai———
cogvlm2-llama3-chat-19BZ.ai———
cogvlm2-llama3-chinese-chat-19BZ.ai———
cogvlm2-video-llama3-chatZ.ai———
CommandCohere———
Command A 03 2025Cohere———
Command A Plus 05 2026Cohere———
Command A Reasoning 08 2025Cohere———
Command A Translate 08 2025Cohere———
Command A Vision 07 2025Cohere———
Command LightCohere———
Command R 03 2024Cohere———
Command R 08 2024Cohere———
Command R Plus 04 2024Cohere———
Command R Plus 08 2024Cohere———
Command R7B 12 2024Cohere———
DeepSeek V4 Flash 0424DeepSeek———
DeepSeek V4-Pro 0424DeepSeek———
DeepSeek V4.1 FlashDeepSeek———
DeepSeek-R1-0528DeepSeek———
DeepSeek-R1-0528-Qwen3-8BDeepSeek———
DeepSeek-R1-Distill-Llama-70BDeepSeek———
DeepSeek-R1-Distill-Llama-8BDeepSeek———
DeepSeek-R1-Distill-Qwen-1.5BDeepSeek———

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Claude Fable 5Anthropic80%Anthropic SWE-bench Pro reported systemlab self-report

Systemcard section8.2: SWEPro average overfive trials, adaptive max effort/defaultsampling. Agent equivalence to miniSWE is not documented; retain distinct reported-system harness, exclude preferred-agent aggregate.

2026-09-01
Claude Fable 5.1Anthropic81.2%Anthropic SWE-bench Pro reported systemlab self-report

Systemcard section8.2: SWEPro average overfive trials, adaptive max effort/defaultsampling. Agent equivalence to miniSWE is not documented; retain distinct reported-system harness, exclude preferred-agent aggregate.

2026-09-01