RankingProgramBench

ProgramBench

Data updated 8 Oct 2026

Bucket: Supporting evidence
Unit: percent
Direction: Higher is better
Version: —
Display harness: Claude Haiku 5.5 System Card
Board: https://www-cdn.anthropic.com/e1080d6bf5ae2018ea3c2f414064be03232f5be5/Claude%20Haiku%205.5%20System%20Card.pdf

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–1 of 1 entries

Model	Score	Harness	Evidence	Source-recorded date
Claude Haiku 5.5Anthropic	82% Reported settings & source Modified 166-task subset after excluding 34 flaky-reference tasks; hidden-test pass rate; mini-swe-agent harness without upstream six-hour limit; no internet or decompilation. Effort is not explicitly stated in this section. Provider-published lab_self_report; retained as launch evidence, not an independent board admission. Not the unmodified 200-task benchmark; scores only tests passed by reference binaries. Comparison limit: Provider publication; exact benchmark-specific configuration and independent evaluation provenance require separate review before matched-board admission. Claude Haiku 5.5 System Card · section 8.7.1; p.117 · reviewed 2026-10-07	Claude Haiku 5.5 System Card	lab self-report	2026-10-07