RankingMistral Large 3

Mistral Large 3

Compare models

Data updated 22 Oct 2026

7 published benchmark measures · 2 benchmark families contribute across 2 task areas. 1 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →

Performance profile

Capabilities

Adjusted comparison score · 0–100
Mistral Large 3 capability radarComparison scores from 0 to 100. Unknown capabilities have no point; lines stop at gaps. Hollow points are preliminary. Exact values and support labels follow the chart.AgenticHard reasoningCodingHuman prefKnowledgeMultimodalLong context50100Mistral Large 3 · Agentic: 1.9 · Preliminary

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic1 families · 1 with independent evidence · Preliminary1.9

1 core families; 42 direct opponents across 17 labs. Needs broader benchmark and opponent support

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 13/13 scenarios unsupported. Without one publisher: No supported estimate; 15/15 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

  • GDPval: 31.0 observed win share
    artificialanalysis.ai · Source 1
Hard reasoningNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 6/6 scenarios unsupported. Without one publisher: No supported estimate; 16/16 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

    CodingNo comparable evidenceUnknown

    0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

    Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

    Refit without one family: No supported estimate; 6/6 scenarios unsupported. Without one publisher: No supported estimate; 19/19 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

    Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

    Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

      Human pref1 families · 1 with independent evidence · PreliminaryUnknown

      1 core families; 76 direct opponents across 17 labs. No connected comparison to the complete reference panel

      Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

      Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

      Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

      Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

      • Human preference (Arena): 47.4 observed win share
        lmarena.ai · Source 1
      KnowledgeNo comparable evidenceUnknown

      0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

      Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

      Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

      Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

      Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

        MultimodalNo comparable evidenceUnknown

        0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

        Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

        Refit without one family: No supported estimate; 8/8 scenarios unsupported. Without one publisher: No supported estimate; 8/8 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

        Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

        Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

          Long contextNo comparable evidenceUnknown

          0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

          Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

          Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

          Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

          Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

            Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

            Reported effort · Not specified

            Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

            Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

            Inspect each result and its source ↓ · Download effort evidence
            Score contributions and missing evidence

            2 contributing families across 2 capabilities. Fixed reference panels do not change when the catalog expands.

            Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

            Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

            Model information & shareable badge
            Lab
            Mistral
            Catalog status
            api-listed
            Availability
            Documented provider API; account and region restrictions may apply
            Family
            Mistral
            Released
            —
            Context
            —
            License
            Apache 2.0
            Model card
            https://docs.mistral.ai/models
            Default Capability family coverage
            Documented-evidence family coverage/badge/mistral-large-3.svg
            Benchmark scores & sources

            Original results, evaluation harnesses, and evidence behind this model.

            BenchmarkBucketScoreHarnessEvidenceSource-recorded date
            AutomationBench-AASupporting evidence1.4974701708193463%Artificial Analysis AutomationBench-AA

            Effort: Not specified

            official board

            Supporting evidence outside the reviewed capability core

            2026-10-20
            DAYJOB FinanceSupporting evidence0%DAYJOB Finance · unspecified

            Effort: Not specified

            official board

            Supporting evidence outside the reviewed capability core

            2026-10-21
            DAYJOB HealthcareSupporting evidence0%DAYJOB Healthcare · unspecified

            Effort: Not specified

            official board

            Supporting evidence outside the reviewed capability core

            2026-10-21
            GDPval-AAAgentic420Artificial Analysis GDPval-AA

            Effort: Not specified

            contributes to capability
            official board2026-10-22
            GPQA DiamondHard reasoning68.43%GPQA Diamond reported

            Effort: Not specified

            independent repro

            No matched opponent in this evaluation unit

            2026-09-04
            LMArena Text ArenaHuman pref1415LMArena Text

            Effort: Not specified

            contributes to capability
            official board2026-10-20
            ThinkingBox-BenchSupporting evidence4.66%ThinkingBox-Bench pass@1

            Effort: Not specified

            official board

            Supporting evidence outside the reviewed capability core

            2026-10-03
            ARC-AGI-2Hard reasoning————
            DeepSWE v1.1Agentic————
            Humanity's Last ExamHard reasoning————
            LiveCodeBenchCoding————
            MMLU-ProKnowledge————
            OSWorld-VerifiedAgentic————
            SWE-bench ProAgentic————
            SWE-bench VerifiedAgentic————
            Terminal-Bench 2.1Agentic————