RankingSWE-bench Pro
SWE-bench Pro
- Bucket
- Coding
- Unit
- percent
- Direction
- Higher is better
- Version
- public
- Display harness
- SWE-bench Pro reported
- Board
- https://labs.scale.com/leaderboard/swe_bench_pro
Compare published benchmark results with category weights →
Models
176–200 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| glm-edge-v-2bZ.ai | — | — | — |
| glm-edge-v-5bZ.ai | — | — | — |
| GLM-Z1-32B-0414Z.ai | — | — | — |
| GLM-Z1-9B-0414Z.ai | — | — | — |
| GLM-Z1-Rumination-32B-0414Z.ai | — | — | — |
| GPT-3.5-turboOpenAI | — | — | — |
| GPT-3.5-turbo-1106OpenAI | — | — | — |
| GPT-3.5-turbo-instructOpenAI | — | — | — |
| GPT-4OpenAI | — | — | — |
| GPT-4-turboOpenAI | — | — | — |
| GPT-4.1OpenAI | — | — | — |
| GPT-4.1 MiniOpenAI | — | — | — |
| GPT-4.1-nanoOpenAI | — | — | — |
| GPT-4oOpenAI | — | — | — |
| GPT-4o MiniOpenAI | — | — | — |
| GPT-5OpenAI | — | — | — |
| GPT-5 MiniOpenAI | — | — | — |
| GPT-5 NanoOpenAI | — | — | — |
| GPT-5 ProOpenAI | — | — | — |
| GPT-5.1OpenAI | — | — | — |
| GPT-5.2OpenAI | — | — | — |
| GPT-5.2 ProOpenAI | — | — | — |
| GPT-5.3 CodexOpenAI | — | — | — |
| GPT-5.3 Codex SparkOpenAI | — | — | — |
| GPT-5.4 MiniOpenAI | — | — | — |
Other harnesses
These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Fable 5Anthropic | 80% | Anthropic SWE-bench Pro reported system | lab self-report | 2026-09-01 |
| Claude Fable 5.1Anthropic | 81.2% | Anthropic SWE-bench Pro reported system | lab self-report | 2026-09-01 |