RankingSWE-bench Pro
SWE-bench Pro
SWE-bench Pro is published here as its own result table. Scores use percent, and higher values rank better. The display harness is Claude Fable 5.1 and Claude Mythos 5.1 System Card. Data updated 22 Nov 2026.
- Bucket
- Coding
- Unit
- percent
- Direction
- Higher is better
- Version
- —
- Display harness
- Claude Fable 5.1 and Claude Mythos 5.1 System Card
- Board
- https://www.anthropic.com/claude-fable-5-1-mythos-5-1-system-card
Compare published benchmark results with category weights →
Models
1–6 of 6 entries
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Fable 5.1Anthropic | 81.2%Reported settings & sourceAnthropic reported configuration; adaptive thinking at max effort, default sampling, five-trial mean unless section specifies otherwise; context at most 1M. Comparator configuration follows cited prior card or board. Agent identity is not established as mini-swe-agent. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · Table 8.1.A; section 8.2 · reviewed 2026-11-22 | Claude Fable 5.1 and Claude Mythos 5.1 System Card | lab self-report | 2026-11-22 |
| Claude Fable 5Anthropic | 80%Reported settings & sourceAnthropic reported configuration; adaptive thinking at max effort, default sampling, five-trial mean unless section specifies otherwise; context at most 1M. Comparator configuration follows cited prior card or board. Agent identity is not established as mini-swe-agent. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · Table 8.1.A; section 8.2 · reviewed 2026-11-22 | Claude Fable 5.1 and Claude Mythos 5.1 System Card | lab self-report | 2026-11-22 |
| Claude Opus 5Anthropic | 79.2%Reported settings & sourceAnthropic reported configuration; adaptive thinking at max effort, default sampling, five-trial mean unless section specifies otherwise; context at most 1M. Comparator configuration follows cited prior card or board. Agent identity is not established as mini-swe-agent. Claude Fable 5.1 and Claude Mythos 5.1 System Card · Table 8.1.A; section 8.2 · reviewed 2026-11-22 | Claude Fable 5.1 and Claude Mythos 5.1 System Card | lab self-report | 2026-11-22 |
| GPT-5.6 SolOpenAI | 64.6%Reported settings & sourceAnthropic reported configuration; adaptive thinking at max effort, default sampling, five-trial mean unless section specifies otherwise; context at most 1M. Comparator configuration follows cited prior card or board. Agent identity is not established as mini-swe-agent. Claude Fable 5.1 and Claude Mythos 5.1 System Card · Table 8.1.A; section 8.2 · reviewed 2026-11-22 | Claude Fable 5.1 and Claude Mythos 5.1 System Card | lab self-report | 2026-11-22 |
| Claude Haiku 5.5Anthropic | 64.8%Reported settings & sourceAdaptive thinking at max effort; default sampling; five-trial mean; evaluation-dependent context at most 1M (Table 8.1.A). Actively maintained repositories; large multi-file diffs. Provider-published lab_self_report; retained as launch evidence, not an independent board admission. Comparison limit: Provider publication; exact benchmark-specific configuration and independent evaluation provenance require separate review before matched-board admission. Claude Haiku 5.5 System Card · Table 8.1.A; section 8.2; pp.111–112 · reviewed 2026-10-07 | Claude Haiku 5.5 System Card | lab self-report | 2026-10-07 |
| Claude Opus 5.5Anthropic | 89.9%Reported settings & sourceAdaptive thinking at max effort; default sampling; five-trial mean; context at most 1M. SWE-bench Pro problems from actively maintained repositories with large multi-file diffs. Provider-published lab self-report from the Claude Opus 5.5 system card (SHA256 7311c9c6bbb16d012f1c12c7418b05949fcf7ae3e30d2c40f22050074b2a7378). Not an independent board. Launch grid shows 89.9%. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Claude Opus 5.5 System Card · Table 8.1.A; section 8.2 · reviewed 2026-09-22 | Claude Opus 5.5 System Card | lab self-report | 2026-09-22 |