RankingProgramBench

ProgramBench

Data updated 22 Nov 2026

ProgramBench is published here as its own result table. Scores use percent, and higher values rank better. The display harness is Claude Haiku 5.5 System Card. Data updated 22 Nov 2026.

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
—
Display harness
Claude Haiku 5.5 System Card
Board
https://www-cdn.anthropic.com/e1080d6bf5ae2018ea3c2f414064be03232f5be5/Claude%20Haiku%205.5%20System%20Card.pdf

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–1 of 1 entries

ModelScoreHarnessEvidenceSource-recorded date
Claude Haiku 5.5Anthropic82%
Reported settings & source

Modified 166-task subset after excluding 34 flaky-reference tasks; hidden-test pass rate; mini-swe-agent harness without upstream six-hour limit; no internet or decompilation. Effort is not explicitly stated in this section.

Provider-published lab_self_report; retained as launch evidence, not an independent board admission. Not the unmodified 200-task benchmark; scores only tests passed by reference binaries.

Comparison limit: Provider publication; exact benchmark-specific configuration and independent evaluation provenance require separate review before matched-board admission.

Claude Haiku 5.5 System Card · section 8.7.1; p.117 · reviewed 2026-10-07

Claude Haiku 5.5 System Cardlab self-report2026-10-07