RankingAllenAI IFBench · source release snapshot; version not specified

AllenAI IFBench · source release snapshot; version not specified

Data updated 12 Sept 2026

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
Mistral Medium 3.5 model card performance charts
Board
https://huggingface.co/mistralai/Mistral-Medium-3.5-128B

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
Qwen3.5-397B-A17BQwen76.5%
Reported settings & source

Maximum reasoning; Sonnet4.6 external API truncation caveat.

First-party reported result; comparator results retain the source evaluation setup.

Mistral Medium 3.5 model card performance charts · images/image1.png · reviewed 2026-09-06

Mistral Medium 3.5 model card performance chartslab self-report2026-09-06
Mistral Medium 3.5Mistral69%
Reported settings & source

Maximum reasoning; Sonnet4.6 external API truncation caveat.

First-party reported result; comparator results retain the source evaluation setup.

Mistral Medium 3.5 model card performance charts · images/image1.png · reviewed 2026-09-06

Mistral Medium 3.5 model card performance chartslab self-report2026-09-06
GLM-5Z.ai67%
Reported settings & source

Maximum reasoning; Sonnet4.6 external API truncation caveat.

First-party reported result; comparator results retain the source evaluation setup.

Mistral Medium 3.5 model card performance charts · images/image1.png · reviewed 2026-09-06

Mistral Medium 3.5 model card performance chartslab self-report2026-09-06
Claude Sonnet 4.6Anthropic57.1%
Reported settings & source

Maximum reasoning; Sonnet4.6 external API truncation caveat.

First-party reported result; comparator results retain the source evaluation setup.

Mistral Medium 3.5 model card performance charts · images/image1.png · reviewed 2026-09-06

Mistral Medium 3.5 model card performance chartslab self-report2026-09-06
Claude Sonnet 4.5Anthropic55.4%
Reported settings & source

Maximum reasoning; Sonnet4.6 external API truncation caveat.

First-party reported result; comparator results retain the source evaluation setup.

Mistral Medium 3.5 model card performance charts · images/image1.png · reviewed 2026-09-06

Mistral Medium 3.5 model card performance chartslab self-report2026-09-06