UnifyBench

RankingMiniMax-M2.7

MiniMax-M2.7

Data updated 12 Sept 2026

52 published benchmark measures · 16 benchmark families contribute across 6 task areas. 4 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

Choose a configuration

A model-wide score would mix effort settings. This page summarizes published evidence; only identified configurations receive leaderboard ranks.

Compare measured configurations →

The capability chart summarizes evidence across reported settings, not a runnable configuration or a leaderboard rank.

Performance profile

Capabilities

Adjusted comparison score · 0–100
MiniMax-M2.7 capability radarComparison scores from 0 to 100. Unknown capabilities have no point; lines stop at gaps. Hollow points are preliminary. Exact values and support labels follow the chart.AgenticHard reasoningCodingHuman prefKnowledgeMultimodalLong context50100MiniMax-M2.7 · Agentic: 5.5 · SupportedMiniMax-M2.7 · Hard reasoning: 1.6 · SupportedMiniMax-M2.7 · Coding: 1.3 · SupportedMiniMax-M2.7 · Human pref: 12.5 · Supported

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic4 families · 1 with independent evidence · Supported5.5

4 core families; 46 direct opponents across 19 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 3.6–7.2; 0/11 scenarios unsupported. Without one publisher: 4.6–86.5; 0/15 unsupported. Smoothing check: 3.0–12.5; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Hard reasoning3 families · 0 with independent evidence · Supported1.6

3 core families; 4 direct opponents across 4 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 1.2–3.1; 0/7 scenarios unsupported. Without one publisher: 0.5–7.9; 1/16 unsupported. Smoothing check: 0.3–8.5; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

  • GPQA: 25.0 observed win share
    NVIDIA · Source 1
  • Humanity’s Last Exam: 0.0 observed win share
    NVIDIA · Source 1
  • Imo Answerbench: 0.0 observed win share
    NVIDIA · Source 1 Source 2
Coding6 families · 0 with independent evidence · Supported1.3

6 core families; 9 direct opponents across 8 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 0.4–8.6; 0/7 scenarios unsupported. Without one publisher: 0.7–8.6; 0/20 unsupported. Smoothing check: 0.5–4.9; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

  • SWE-bench Pro: 16.7 observed win share
    MiniMax · Source 1
  • SWE-bench Verified: 33.3 observed win share
    MiniMax, NVIDIA · Source 1 Source 2
  • Terminal-Bench: 29.2 observed win share
    MiniMax, NVIDIA · Source 1 Source 2
  • LiveCodeBench: 0.0 observed win share
    NVIDIA · Source 1
  • SWE-bench Multilingual: 50.0 observed win share
    NVIDIA · Source 1
  • Scicode: 0.0 observed win share
    NVIDIA · Source 1
Human pref1 families · 1 with independent evidence · Supported12.5

1 core families; 114 direct opponents across 19 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: 4.5–25.8; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

  • Human preference (Arena): 59.6 observed win share
    lmarena.ai · Source 1
Knowledge1 families · 0 with independent evidence · PreliminaryUnknown

1 core families; 4 direct opponents across 4 labs. No connected comparison to the complete reference panel

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

MultimodalNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 8/8 scenarios unsupported. Without one publisher: No supported estimate; 8/8 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

    Long context1 families · 0 with independent evidence · PreliminaryUnknown

    1 core families; 4 direct opponents across 4 labs. No connected comparison to the complete reference panel

    Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

    Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

    Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

    Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

    • Aa Lcr: 75.0 observed win share
      NVIDIA · Source 1

    Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

    Compare 2 effort levels across 29 benchmark/harness combinations →

    Reported effort · Not specified

    Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

    Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

    Inspect each result and its source ↓ · Download effort evidence

    Compare capability profiles →

    Score contributions and missing evidence

    16 contributing families across 6 capabilities. Fixed reference panels do not change when the catalog expands.

    Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

    Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

    Model information & shareable badge
    Lab
    MiniMax
    Catalog status
    active
    Availability
    Documented provider API; downloadable official weights
    Family
    MiniMax
    Released
    —
    Context
    204,800 tokens
    License
    —
    Model card
    https://platform.minimax.io/docs/api-reference/text-anthropic-api
    Default Capability family coverage
    Documented-evidence family coverage/badge/minimax-m2.7.svg
    Benchmark scores & sources

    Original results, evaluation harnesses, and evidence behind this model.

    BenchmarkBucketScoreHarnessEvidenceSource-recorded date
    AA-LCR · source release snapshot; version not specifiedLong context69.8%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 69.8

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: AA-LCR · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    APEX-Agents · source release snapshot; version not specifiedAgentic5.6%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    Apex-Shortlist (no tools) · source release snapshot; version not specifiedSupporting evidence28.9%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 28.9

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Apex-Shortlist (no tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    Apex-Shortlist (with tools) · source release snapshot; version not specifiedSupporting evidence51.9%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 51.9

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Apex-Shortlist (with tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    BankerToolBench · source release snapshot; version not specifiedSupporting evidence63.9%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    BrowseComp · source release snapshot; version not specifiedAgentic76.3%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    BrowseComp · source release snapshot; version not specifiedAgentic54.1%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 54.1

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: BrowseComp · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    CL-bench · source release snapshot; version not specifiedSupporting evidence15.4%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    Claw-Eval · source release snapshot; version not specifiedSupporting evidence49.7%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    CritPt (no tools) · source release snapshot; version not specifiedSupporting evidence0.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 0.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: CritPt (no tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    DRACO · source release snapshot; version not specifiedSupporting evidence66.8%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    GDPVal · source release snapshot; version not specifiedAgentic47.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 47.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: GDPVal · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    GDPval rubrics · source release snapshot; version not specifiedAgentic66.4%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    GDPval-AAAgentic1087Artificial Analysis GDPval-AA

    Effort: Not specified

    contributes to capability    		official board2026-09-12
    GPQA (no tools) · source release snapshot; version not specifiedHard reasoning86.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 86.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: GPQA (no tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    HLE (no tools) · source release snapshot; version not specifiedHard reasoning23.1%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 23.1

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: HLE (no tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    IFBench (prompt loose) · source release snapshot; version not specifiedSupporting evidence74.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 74.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IFBench (prompt loose) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    IMOAnswerBench (no tools) · source release snapshot; version not specifiedHard reasoning68.3%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 68.3

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (no tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    IMOAnswerBench (with tools) · source release snapshot; version not specifiedHard reasoning75.1%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 75.1

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (with tools) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    KernelBench Hard · source release snapshot; version not specifiedSupporting evidence10.5%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    LiveCodeBench (v6) · source release snapshot; version not specifiedCoding77.2%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 77.2

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: LiveCodeBench (v6) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    LiveSQLBench · source release snapshot; version not specifiedSupporting evidence33.2%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    LMArena Text ArenaHuman pref1415LMArena Text

    Effort: Not specified

    contributes to capability    		official board2026-09-11
    MCPAtlas · source release snapshot; version not specifiedAgentic49.4%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    MMLU-Pro · source release snapshot; version not specifiedKnowledge81.9%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 81.9

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: MMLU-Pro · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    MMLU-ProX (avg en/de/fr/es/it/ja/zh/hi/pt/ko) · source release snapshot; version not specifiedKnowledge78.4%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 78.4

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: MMLU-ProX (avg en/de/fr/es/it/ja/zh/hi/pt/ko) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    Multi-Challenge · source release snapshot; version not specifiedSupporting evidence42.5%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 42.5

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Multi-Challenge · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    NL2Repo · source release snapshot; version not specifiedSupporting evidence35%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    OmniScience Accuracy · source release snapshot; version not specifiedSupporting evidence20.5%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 20.5

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: OmniScience Accuracy · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    PaperBench · source release snapshot; version not specifiedSupporting evidence30.6%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    PinchBench · source release snapshot; version not specifiedSupporting evidence77.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 77.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: PinchBench · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    PostTrainBench · source release snapshot; version not specifiedSupporting evidence13.1%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    ProfBench (Search) · source release snapshot; version not specifiedSupporting evidence52%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 52.0

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: ProfBench (Search) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    SciCode (subtask) · source release snapshot; version not specifiedCoding38.3%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 38.3

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: SciCode (subtask) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    SpreadsheetBench v1 · source release snapshot; version not specifiedSupporting evidence84.9%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    SVG-Bench · source release snapshot; version not specifiedSupporting evidence48%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    SWE-Bench Multilingual · source release snapshot; version not specifiedCoding71.8%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 71.8

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: SWE-Bench Multilingual · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    SWE-bench Pro · source release snapshot; version not specifiedCoding56.2%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    SWE-bench Verified · source release snapshot; version not specifiedCoding79.9%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    SWE-Bench Verified · source release snapshot; version not specifiedCoding75.3%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 75.3

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: SWE-Bench Verified · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    SWE-fficiency · source release snapshot; version not specifiedSupporting evidence14%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    SWEAtlas-QnA · source release snapshot; version not specifiedSupporting evidence11.3%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    SWEAtlas-TestWriting · source release snapshot; version not specifiedSupporting evidence18.9%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    TauBench V3 Airline · source release snapshot; version not specifiedSupporting evidence75.3%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 75.3

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Airline · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    TauBench V3 Average · source release snapshot; version not specifiedSupporting evidence66.1%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 66.1

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Average · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    TauBench V3 Banking · source release snapshot; version not specifiedSupporting evidence14.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 14.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Banking · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    TauBench V3 Retail · source release snapshot; version not specifiedSupporting evidence84.9%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 84.9

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Retail · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    TauBench V3 Telecom · source release snapshot; version not specifiedSupporting evidence89.6%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 89.6

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Telecom · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    Terminal Bench 2.1 · 2.1Coding55.5%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 55.5 The linked public reproduction recipe names Terminal Bench 2.0, while this card labels 2.1. Recipe settings are not transferred across that unresolved version mismatch.

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Terminal Bench 2.1 · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    Terminal-Bench 2.1 · 2.1Coding51.1%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    contributes to capability    		lab self-reportReviewed 2026-09-06
    Vals.ai Financial Agent 1.1 with web search · 1.1Supporting evidence50.5%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 50.5

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: with web search · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    Vals.ai Financial Agent 1.1 without web search · 1.1Supporting evidence51.3%
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 51.3

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: without web search · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    VIBE-V2 · source release snapshot; version not specifiedSupporting evidence37.9%
    Reported settings & source

    MiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted.

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    WMT24++ (en→xx) · source release snapshot; version not specifiedSupporting evidence82.8 score (source scale)
    Reported settings & source

    NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

    First-party reported result. Original cell: 82.8

    nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: WMT24++ (en→xx) · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    YC-Bench · source release snapshot; version not specifiedSupporting evidence0 USD
    Reported settings & source

    Launch figure; agent final assets

    First-party reported result; comparator results retain the source evaluation setup.

    MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06

    		Published configuration

    Effort: Not specified

    		lab self-report

    Supporting evidence outside the reviewed capability core

    		Reviewed 2026-09-06
    ARC-AGI-2Hard reasoning————
    DeepSWE v1.1Agentic————
    GPQA DiamondHard reasoning————
    Humanity's Last ExamHard reasoning————
    LiveCodeBenchCoding————
    MMLU-ProKnowledge————
    OSWorld-VerifiedAgentic————
    SWE-bench ProAgentic————
    SWE-bench VerifiedAgentic————
    Terminal-Bench 2.1Agentic————