RankingBenchCAD · Vision2Code 1000-file subset

BenchCAD · Vision2Code 1000-file subset

Data updated 22 Nov 2026

BenchCAD · Vision2Code 1000-file subset is published here as its own result table, version Vision2Code 1000-file subset. Scores use index, and higher values rank better. The display harness is Claude Fable 5.1 and Claude Mythos 5.1 System Card. Data updated 22 Nov 2026.

Bucket
Supporting evidence
Unit
index
Direction
Higher is better
Version
Vision2Code 1000-file subset
Display harness
Claude Fable 5.1 and Claude Mythos 5.1 System Card
Board
https://www.anthropic.com/claude-fable-5-1-mythos-5-1-system-card

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–10 of 10 entries

ModelScoreHarnessEvidenceSource-recorded date
Claude Fable 5.1Anthropic0.437 voxel IoU
Reported settings & source

Random1000 of17900files; five runs; adaptive thinking max; no tools; corrected camera prompt, raw shapes accepted, last code fence parsed.

Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures.

Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.2 · reviewed 2026-11-22

Claude Fable 5.1 and Claude Mythos 5.1 System Cardlab self-report2026-11-22
Claude Fable 5Anthropic0.376 voxel IoU
Reported settings & source

Random1000 of17900files; five runs; adaptive thinking max; no tools; corrected camera prompt, raw shapes accepted, last code fence parsed.

Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures.

Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.2 · reviewed 2026-11-22

Claude Fable 5.1 and Claude Mythos 5.1 System Cardlab self-report2026-11-22
Claude Opus 5Anthropic0.366 voxel IoU
Reported settings & source

Random1000 of17900files; five runs; adaptive thinking max; no tools; corrected camera prompt, raw shapes accepted, last code fence parsed.

Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.2 · reviewed 2026-11-22

Claude Fable 5.1 and Claude Mythos 5.1 System Cardlab self-report2026-11-22
Claude Fable 5Anthropic0.675 voxel IoU
Reported settings & source

Random1000 of17900files; five runs; adaptive thinking max; with tools; corrected camera prompt, raw shapes accepted, last code fence parsed.

Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures.

Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.2 · reviewed 2026-11-22

Claude Fable 5.1 and Claude Mythos 5.1 System Cardlab self-report2026-11-22
Claude Fable 5.1Anthropic0.843 voxel IoU
Reported settings & source

Random1000 of17900files; five runs; adaptive thinking max; with tools; corrected camera prompt, raw shapes accepted, last code fence parsed.

Fable is the safeguarded deployed configuration; selected tasks may use disclosed Opus fallback, except evaluations explicitly counting safety blocks as failures.

Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.2 · reviewed 2026-11-22

Claude Fable 5.1 and Claude Mythos 5.1 System Cardlab self-report2026-11-22
Claude Haiku 5.5Anthropic0.67 voxel IoU
Reported settings & source

Adaptive thinking at max effort; without tools; mean of five runs. Random1000-file subset of17900 Vision2Code files; execution-verified CadQuery; voxel IoU.

Provider-published lab_self_report; retained as launch evidence, not an independent board admission.

Comparison limit: Provider publication; exact benchmark-specific configuration and independent evaluation provenance require separate review before matched-board admission.

Claude Haiku 5.5 System Card · section 8.9.2; pp.125–127 · reviewed 2026-10-07

Claude Haiku 5.5 System Cardlab self-report2026-10-07
Claude Haiku 5.5Anthropic0.87 voxel IoU
Reported settings & source

Adaptive thinking at max effort; with tools; mean of five runs. Random1000-file subset of17900 Vision2Code files; execution-verified CadQuery; voxel IoU. Container with image files, standard libraries and cropping tool.

Provider-published lab_self_report; retained as launch evidence, not an independent board admission.

Comparison limit: Provider publication; exact benchmark-specific configuration and independent evaluation provenance require separate review before matched-board admission.

Claude Haiku 5.5 System Card · section 8.9.2; pp.125–127 · reviewed 2026-10-07

Claude Haiku 5.5 System Cardlab self-report2026-10-07
Claude Opus 5Anthropic0.821 voxel IoU
Reported settings & source

Random1000 of17900files; five runs; adaptive thinking max; with tools; corrected camera prompt, raw shapes accepted, last code fence parsed.

Claude Fable 5.1 and Claude Mythos 5.1 System Card · 8.14.2 · reviewed 2026-11-22

Claude Fable 5.1 and Claude Mythos 5.1 System Cardlab self-report2026-11-22
Claude Opus 5.5Anthropic0.73 voxel IoU
Reported settings & source

Random 1,000 of 17,900 Vision2Code files; five runs; adaptive thinking at max effort; no tools; views rendered at 256x256 px, the resolution Anthropic says matches the reference implementation.

Provider-published lab self-report from the Claude Opus 5.5 system card (SHA256 7311c9c6bbb16d012f1c12c7418b05949fcf7ae3e30d2c40f22050074b2a7378). Not an independent board. Earlier cards used 128x128 px renders. This section publishes the corrected resolution.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Claude Opus 5.5 System Card · section 8.13.2 · reviewed 2026-09-22

Claude Opus 5.5 System Cardlab self-report2026-09-22
Claude Opus 5.5Anthropic0.962 voxel IoU
Reported settings & source

Random 1,000 of 17,900 Vision2Code files; five runs; adaptive thinking at max effort; with tools (container, image files, standard libraries, and an image cropping tool); 256x256 px views.

Provider-published lab self-report from the Claude Opus 5.5 system card (SHA256 7311c9c6bbb16d012f1c12c7418b05949fcf7ae3e30d2c40f22050074b2a7378). Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Claude Opus 5.5 System Card · section 8.13.2 · reviewed 2026-09-22

Claude Opus 5.5 System Cardlab self-report2026-09-22