RankingIF Bench · source release snapshot; version not specified

IF Bench · source release snapshot; version not specified

Data updated 12 Sept 2026

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
MAI-Thinking-1 technical report
Board
https://microsoft.ai/pdf/mai-thinking-1.pdf

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
MAI-Thinking-1Microsoft69%
Reported settings & source

Microsoft own evaluation suite; Sonnet max reasoning; Tables 12/19. LongBenchV2 capped 256k,408 questions; CorpusQA GPT-5.4 high judge; 4 runs.

First-party reported result; comparator results retain the source evaluation setup.

MAI-Thinking-1 technical report · Tables 12 and 19 · reviewed 2026-09-06

MAI-Thinking-1 technical reportlab self-report2026-09-06
Claude Sonnet 4.6Anthropic50%
Reported settings & source

Microsoft own evaluation suite; Sonnet max reasoning; Tables 12/19. LongBenchV2 capped 256k,408 questions; CorpusQA GPT-5.4 high judge; 4 runs.

First-party reported result; comparator results retain the source evaluation setup.

MAI-Thinking-1 technical report · Tables 12 and 19 · reviewed 2026-09-06

MAI-Thinking-1 technical reportlab self-report2026-09-06