RankingSurge human coding quality

Surge human coding quality

Data updated 8 Oct 2026

Bucket
Supporting evidence
Unit
index
Direction
Higher is better
Version
—
Display harness
Introducing Mistral Large 4 — public preview
Board
https://mistral.ai/news/mistral-large-4/

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–1 of 1 entries

ModelScoreHarnessEvidenceSource-recorded date
Mistral Large 4Mistral3.74 rating (1–5)
Reported settings & source

Public Mistral Large4 Preview. Effort, sampling and evaluation budgets are not stated. Blind professional-annotator assessment on1–5 scale; model identities hidden; SurgeAI evaluation.

Provider-published lab_self_report; retained as launch evidence, not an independent board admission. Exact printed chart label; asset https://mistral.ai/_astro/human-evaluation---surge-(human-eval-on-code)%201_20jgWu.webp?dpl=6ac6a8353c2a68969e300fd2; asset SHA256 b79d8103a1d51c51c16a6b78ef8000422726c74129dff70e00797d8d04869bfc.

Comparison limit: Provider publication; exact benchmark-specific configuration and independent evaluation provenance require separate review before matched-board admission.

Introducing Mistral Large 4 — public preview · Capabilities deep-dive; Surge human coding quality; chart 11 (mistral-chart-11.webp) · reviewed 2026-10-07

Introducing Mistral Large 4 — public previewlab self-report2026-10-07