RankingSWE-bench Pro
SWE-bench Pro
- Bucket
- Coding
- Unit
- percent
- Direction
- Higher is better
- Version
- public
- Display harness
- SWE-bench Pro reported
- Board
- https://labs.scale.com/leaderboard/swe_bench_pro
Compare published benchmark results with category weights →
Models
1–25 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| Claude Opus 5Anthropic | 79.2% | lab self-report | 2026-07-24 |
| Qwen 3.8-MaxQwen | 67.7% | lab self-report | 2026-08-03 |
| GPT-5.6 SolOpenAI | 64.6% | lab self-report | 2026-07-09 |
| Muse Spark 1.1Meta | 61.5% | official board | 2026-07-09 |
| GPT-5.4OpenAI | 59.1% | official board | 2026-04-08 |
| DeepSeek V4-Pro 0813DeepSeek | 55.4% | lab self-report | 2026-08-13 |
| Claude Opus 4.6Anthropic | 51.9% | official board | 2026-04-08 |
| Gemini 3.1 ProGoogle | 46.1% | official board | 2026-04-08 |
| Agnes 2.5 Pro AlphaAgnes AI | — | — | — |
| Agnes-3.0-Flash PreviewAgnes AI | — | — | — |
| Amazon Nova 2 LiteAmazon | — | — | — |
| Amazon Nova 2 Pro PreviewAmazon | — | — | — |
| Amazon Nova LiteAmazon | — | — | — |
| Amazon Nova MicroAmazon | — | — | — |
| Amazon Nova PremierAmazon | — | — | — |
| Amazon Nova ProAmazon | — | — | — |
| AutoGLM-Phone-9BZ.ai | — | — | — |
| AutoGLM-Phone-9B-MultilingualZ.ai | — | — | — |
| aya-101Cohere | — | — | — |
| aya-23-35BCohere | — | — | — |
| aya-23-8BCohere | — | — | — |
| aya-expanse-8bCohere | — | — | — |
| aya-vision-8bCohere | — | — | — |
| C4Ai Aya Expanse 32BCohere | — | — | — |
| C4Ai Aya Vision 32BCohere | — | — | — |
Other harnesses
These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Fable 5Anthropic | 80% | Anthropic SWE-bench Pro reported system | lab self-report | 2026-09-01 |
| Claude Fable 5.1Anthropic | 81.2% | Anthropic SWE-bench Pro reported system | lab self-report | 2026-09-01 |