RankingClaude Fable 5.1

Claude Fable 5.1

Data updated 22 Oct 2026

66 published benchmark measures · 16 benchmark families contribute across 5 task areas. 4 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →

Performance profile

Capabilities

Adjusted comparison score · 0–100

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic5 families · 0 with independent evidence · Supported97.1

5 core families; 4 direct opponents across 2 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 96.3–98.0; 0/13 scenarios unsupported. Without one publisher: 94.0–97.8; 0/15 unsupported. Smoothing check: 90.7–98.9; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

AutomationBench: 87.5 observed win share
Anthropic, OpenAI · Source 1 Source 2
GDPval: 100.0 observed win share
Anthropic · Source 1
OSWorld: 100.0 observed win share
Anthropic · Source 1 Source 2
OfficeQA: 100.0 observed win share
Anthropic · Source 1 Source 2
Terminal-Bench Science: 75.0 observed win share
OpenAI · Source 1

Hard reasoning4 families · 2 with independent evidence · Supported81.4

4 core families; 61 direct opponents across 10 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 75.6–85.1; 0/6 scenarios unsupported. Without one publisher: 71.9–82.7; 0/16 unsupported. Smoothing check: 74.4–84.3; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

GPQA: 40.0 observed win share
OpenAI, artificialanalysis.ai · Source 1 Source 2
ARC-AGI: 52.2 observed win share
Anthropic, OpenAI, arcprize.org · Source 1 Source 2 Source 3 Source 4 Source 5
Humanity’s Last Exam: 100.0 observed win share
Anthropic, OpenAI · Source 1 Source 2 Source 3
FrontierMath: 50.0 observed win share
OpenAI · Source 1

Coding4 families · 1 with independent evidence · Supported93.9

4 core families; 21 direct opponents across 7 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 90.8–96.6; 0/6 scenarios unsupported. Without one publisher: 92.6–94.9; 0/19 unsupported. Smoothing check: 86.0–97.0; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Terminal-Bench: 88.6 observed win share
Anthropic, OpenAI, tbench.ai · Source 1 Source 2 Source 3
SWE-bench Multilingual: 50.0 observed win share
Anthropic · Source 1
SWE-bench Pro: 100.0 observed win share
Anthropic · Source 1
DeepSWE: 0.0 observed win share
OpenAI · Source 1

Human prefNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Knowledge2 families · 0 with independent evidence · PreliminaryUnknown

2 core families; 2 direct opponents across 1 labs. No connected comparison to the complete reference panel

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Gmmlu: 100.0 observed win share
Anthropic · Source 1
Milu: 100.0 observed win share
Anthropic · Source 1

Multimodal1 families · 0 with independent evidence · Preliminary95.1

1 core families; 2 direct opponents across 1 labs. Needs broader benchmark and opponent support

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 8/8 scenarios unsupported. Without one publisher: No supported estimate; 8/8 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Chartography: 100.0 observed win share
Anthropic · Source 1 Source 2

Long contextNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

Reported effort · Mixed settings

Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

Auto thinking: 2 observations
High: 1 observations
Max: 34 observations
Medium: 3 observations
XHigh: 4 observations
Not specified: 65 observations

Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

Inspect each result and its source ↓ · Download effort evidence

Score contributions and missing evidence

16 contributing families across 5 capabilities. Fixed reference panels do not change when the catalog expands.

Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

Model information & shareable badge

Lab: Anthropic
Catalog status: active
Availability: Public provider catalog; account and region restrictions may apply
Family: Claude Fable
Released: —
Context: 1,000,000 tokens
License: proprietary
Model card: https://platform.claude.com/docs/en/about-claude/model-deprecations
Default Capability family coverage: /badge/claude-fable-5-1.svg

Benchmark scores & sources

Original results, evaluation harnesses, and evidence behind this model.

Benchmark	Bucket	Score	Harness	Evidence	Source-recorded date
Chartography	Multimodal	42.6% Reported settings & source 100tasks; adaptive thinking max; five runs; no tools; tools condition has container, standard libraries and crop tool. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.1 · reviewed 2026-10-18	Published configuration Effort: Max contributes to capability	lab self-report	Reviewed 2026-10-18
Chartography	Multimodal	86.2% Reported settings & source 100tasks; adaptive thinking max; five runs; with tools; tools condition has container, standard libraries and crop tool. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.1 · reviewed 2026-10-18	Published configuration Effort: Max contributes to capability	lab self-report	Reviewed 2026-10-18
Chartography	Multimodal	46.2% Reported settings & source Comparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Without tools; results from the official Surge public leaderboard. Provider-published launch claim, not independent measurement by Google for every row. Without tools; results from the official Surge public leaderboard. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 17: Chartography / Claude Fable 5.1; methodology Additional Details · reviewed 2026-09-30	Published configuration Effort: Not specified	lab self-report Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison.	Reviewed 2026-09-30
CursorBench · 3.2.0	Supporting evidence	73.4% Reported settings & source Cursor production agent harness; independently measured by Cursor; max effort. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.8 · reviewed 2026-10-18	Published configuration Effort: Max	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-10-18
CursorBench · 3.2.0	Supporting evidence	68% Reported settings & source Cursor production agent harness; medium effort; $3.53/task. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.8 · reviewed 2026-10-18	Published configuration Effort: Medium	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-10-18
CursorBench · 4.0	Supporting evidence	51.8% Reported settings & source Grok 4.7 XHigh (DeepSWE: High); Grok 4.6 High; GPT-5.6 Sol Max; Claude Fable 5.1 Max. Launch comparison; per-model agent harness, evaluation budget and rerun provenance are not specified. Official launch table. Effort follows the column header except the Grok 4.7 DeepSWE asterisk, which explicitly means High. Comparison limit: The launch table does not establish matching agent harnesses and evaluation settings. Retained as a provider claim; not a new comparable evaluation. Grok 4.7 launch comparison · Model Improvements table: CursorBench · reviewed 2026-09-21	Published configuration Effort: Max	lab self-report The launch table does not establish matching agent harnesses and evaluation settings. Retained as a provider claim; not a new comparable evaluation.	Reviewed 2026-09-21
CWE-bench · 1	Supporting evidence	58% Reported settings & source Comparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Official public leaderboard; ranking uses pass@1 with pass@4 tiebreaks. Grid records pass@1 only. Provider-published launch claim, not independent measurement by Google for every row. Official public leaderboard; ranking uses pass@1 with pass@4 tiebreaks. Grid records pass@1 only. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 19: CWE-bench 1 / Claude Fable 5.1; methodology Additional Details · reviewed 2026-09-30	Published configuration Effort: Not specified	lab self-report Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison.	Reviewed 2026-09-30
DAYJOB Finance	Supporting evidence	19.8%	DAYJOB Finance · max Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-10-21
DAYJOB Healthcare	Supporting evidence	9.6%	DAYJOB Healthcare · max Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-10-21
DeepSWE · 1.1	Coding	67.4% Reported settings & source Anthropic reported configuration; adaptive thinking at max effort, default sampling, five-trial mean unless section specifies otherwise; context at most 1M. Comparator configuration follows cited prior card or board. 113 tasks; original hidden-test grading. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.3 · reviewed 2026-10-18	Published configuration Effort: Max	lab self-report No matched opponent in this evaluation unit	Reviewed 2026-10-18
DeepSWE · 1.1	Coding	67.4% Reported settings & source Comparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Argon self-computed with mini-swe agent. Astra from the official public leaderboard; Fable and Opus from their system cards. Highest scoring thinking level per Datacurve. Provider-published launch claim, not independent measurement by Google for every row. Argon self-computed with mini-swe agent. Astra from the official public leaderboard; Fable and Opus from their system cards. Highest scoring thinking level per Datacurve. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 5: DeepSWE 1.1 / Claude Fable 5.1; methodology Additional Details · reviewed 2026-09-30	Published configuration Effort: Not specified	lab self-report Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison.	Reviewed 2026-09-30
DeepSWE v1.1	Coding	67.4%	Anthropic DeepSWE1.1 reported system Effort: Not specified	lab self-report Legacy self-report lacks a reviewed comparison configuration	2026-09-01
DeepSWE v1.1 · 1.1	Coding	70% Reported settings & source Grok 4.7 XHigh (DeepSWE: High); Grok 4.6 High; GPT-5.6 Sol Max; Claude Fable 5.1 Max. Launch comparison; per-model agent harness, evaluation budget and rerun provenance are not specified. Official launch table. Effort follows the column header except the Grok 4.7 DeepSWE asterisk, which explicitly means High. Comparison limit: The launch table does not establish matching agent harnesses and evaluation settings. Retained as a provider claim; not a new comparable evaluation. Grok 4.7 launch comparison · Model Improvements table: DeepSWE v1.1 · reviewed 2026-09-21	Published configuration Effort: Max	lab self-report The launch table does not establish matching agent harnesses and evaluation settings. Retained as a provider claim; not a new comparable evaluation.	Reviewed 2026-09-21
DeepSWE v1.1 · v1.1	Coding	67.4% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5.1 · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
EEBench	Supporting evidence	56.4% Reported settings & source Grok 4.7 XHigh (DeepSWE: High); Grok 4.6 High; GPT-5.6 Sol Max; Claude Fable 5.1 Max. Launch comparison; per-model agent harness, evaluation budget and rerun provenance are not specified. Official launch table. Effort follows the column header except the Grok 4.7 DeepSWE asterisk, which explicitly means High. Comparison limit: The launch table does not establish matching agent harnesses and evaluation settings. Retained as a provider claim; not a new comparable evaluation. Grok 4.7 launch comparison · Model Improvements table: EEBench · reviewed 2026-09-21	Published configuration Effort: Max	lab self-report The launch table does not establish matching agent harnesses and evaluation settings. Retained as a provider claim; not a new comparable evaluation.	Reviewed 2026-09-21
FrontierCode · 1.1 Extended	Supporting evidence	63.6% Reported settings & source Cognition agentic coding; composite functional and code-quality score. Fable5.1 medium effort; Fable5 xhigh. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.4 · reviewed 2026-10-18	Published configuration Effort: Medium	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-10-18
FrontierCode · 1.1 Main	Supporting evidence	50.9% Reported settings & source Cognition agentic coding; composite functional and code-quality score. Fable5.1 medium effort; Fable5 xhigh. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.4 · reviewed 2026-10-18	Published configuration Effort: Medium	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-10-18
FrontierCode 1.1 Extended (score) · 1.1	Supporting evidence	63.6% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / FrontierCode 1.1 Extended (score) / Claude Fable 5.1 · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-09-06
FrontierCode 1.1 Main (score) · 1.1	Supporting evidence	50.9% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / FrontierCode 1.1 Main (score) / Claude Fable 5.1 · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-09-06
FrontierMath Erdős	Supporting evidence	0%	FrontierMath Erdős proof scorer Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-09-01
FrontierMath Tier 4 (v2) · v2	Hard reasoning	87.8% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Academic table / FrontierMath Tier 4 (v2) / Claude Fable 5.1 · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
FrontierSWE · 2	Supporting evidence	0.57 fraction Reported settings & source Proximal agent harness; max effort; 34 tasks, five trials/task; mean score on 0..1 scale. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Comparison limit: Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall. Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.5 · reviewed 2026-10-18	Published configuration Effort: Max	lab self-report Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall.	Reviewed 2026-10-18
FrontierSWE · 2	Supporting evidence	56.3% Reported settings & source Comparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Results sourced from Proximal's official public leaderboard. Provider-published launch claim, not independent measurement by Google for every row. Results sourced from Proximal's official public leaderboard. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 6: FrontierSWE 2 / Claude Fable 5.1; methodology Additional Details · reviewed 2026-09-30	Published configuration Effort: Not specified	lab self-report Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall.	Reviewed 2026-09-30
FrontierSWE v2	Supporting evidence	56.3%	Proximal FrontierSWE v2 · Proximus · unspecified Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-10-22
GDPval-AA · 2	Agentic	1853 Reported settings & source Artificial Analysis independent agentic shell/web evaluation;220GDPvalgoldtasks; blind pairwise Elo; max effort for Claude. Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures. Claude Fable 5.1 and Claude Mythos 5.1 System Card · Table8.1.A;8.15.3 · reviewed 2026-10-18	Published configuration Effort: Max contributes to capability	lab self-report	Reviewed 2026-10-18