RankingSWE-bench Pro
SWE-bench Pro
- Bucket
- Coding
- Unit
- percent
- Direction
- Higher is better
- Version
- public
- Display harness
- SWE-bench Pro reported
- Board
- https://labs.scale.com/leaderboard/swe_bench_pro
Compare published benchmark results with category weights →
Models
401–425 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| Qwen3-vl-flashQwen | — | — | — |
| Qwen3-vl-plusQwen | — | — | — |
| Qwen3.5-0.8BQwen | — | — | — |
| Qwen3.5-122B-A10BQwen | — | — | — |
| Qwen3.5-27BQwen | — | — | — |
| Qwen3.5-2BQwen | — | — | — |
| Qwen3.5-35B-A3BQwen | — | — | — |
| Qwen3.5-397B-A17BQwen | — | — | — |
| Qwen3.5-4BQwen | — | — | — |
| Qwen3.5-9BQwen | — | — | — |
| Qwen3.5-flashQwen | — | — | — |
| Qwen3.5-omni-flashQwen | — | — | — |
| Qwen3.5-omni-plusQwen | — | — | — |
| Qwen3.5-plusQwen | — | — | — |
| Qwen3.6-27BQwen | — | — | — |
| Qwen3.6-35B-A3BQwen | — | — | — |
| Qwen3.6-flashQwen | — | — | — |
| Qwen3.6-plusQwen | — | — | — |
| Qwen3.7-flashQwen | — | — | — |
| Qwen3.7-maxQwen | — | — | — |
| Qwen3.7-plusQwen | — | — | — |
| Qwen3.8 Max 0902Qwen | — | — | — |
| Qwen3.8-2.4T-A95BQwen | — | — | — |
| Qwen3.8-27BQwen | — | — | — |
| Qwen3.8-flashQwen | — | — | — |
Other harnesses
These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Fable 5Anthropic | 80% | Anthropic SWE-bench Pro reported system | lab self-report | 2026-09-01 |
| Claude Fable 5.1Anthropic | 81.2% | Anthropic SWE-bench Pro reported system | lab self-report | 2026-09-01 |