RankingGLM-5.2

GLM-5.2

Data updated 12 Sept 2026

45 published benchmark measures · 9 benchmark families contribute across 3 task areas. 3 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

Choose a configuration

A model-wide score would mix effort settings. This page summarizes published evidence; only identified configurations receive leaderboard ranks.

Compare measured configurations →

The capability chart summarizes evidence across reported settings, not a runnable configuration or a leaderboard rank.

Performance profile

Capabilities

Adjusted comparison score · 0–100
GLM-5.2 capability radarComparison scores from 0 to 100. Unknown capabilities have no point; lines stop at gaps. Hollow points are preliminary. Exact values and support labels follow the chart.AgenticHard reasoningCodingHuman prefKnowledgeMultimodalLong context50100GLM-5.2 · Agentic: 18.3 · SupportedGLM-5.2 · Hard reasoning: 24.3 · SupportedGLM-5.2 · Coding: 21.9 · Supported

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic4 families · 0 with independent evidence · Supported18.3

4 core families; 9 direct opponents across 6 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 15.9–23.8; 0/11 scenarios unsupported. Without one publisher: 13.8–26.7; 0/15 unsupported. Smoothing check: 10.9–28.8; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Hard reasoning3 families · 1 with independent evidence · Supported24.3

3 core families; 50 direct opponents across 10 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 15.7–42.7; 0/7 scenarios unsupported. Without one publisher: 15.1–28.9; 0/16 unsupported. Smoothing check: 20.2–31.2; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Coding2 families · 1 with independent evidence · Supported21.9

2 core families; 27 direct opponents across 9 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 18.4–26.1; 2/7 scenarios unsupported. Without one publisher: 20.2–26.1; 0/20 unsupported. Smoothing check: 17.0–29.1; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Human prefNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

    KnowledgeNo comparable evidenceUnknown

    0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

    Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

    Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

    Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

    Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

      MultimodalNo comparable evidenceUnknown

      0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

      Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

      Refit without one family: No supported estimate; 8/8 scenarios unsupported. Without one publisher: No supported estimate; 8/8 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

      Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

      Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

        Long contextNo comparable evidenceUnknown

        0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

        Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

        Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

        Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

        Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

          Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

          Compare 7 effort levels across 44 benchmark/harness combinations →

          Reported effort · Max + unspecified

          Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

          Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

          Inspect each result and its source ↓ · Download effort evidence

          Compare capability profiles →

          Score contributions and missing evidence

          9 contributing families across 3 capabilities. Fixed reference panels do not change when the catalog expands.

          Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

          Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

          Model information & shareable badge
          Lab
          Z.ai
          Catalog status
          active
          Availability
          Documented provider API; downloadable official weights
          Family
          GLM
          Released
          Context
          1,000,000 tokens
          License
          MIT
          Model card
          https://docs.z.ai/guides/overview/overview
          Default Capability family coverage
          Documented-evidence family coverage/badge/glm-5.2.svg
          Benchmark scores & sources

          Original results, evaluation harnesses, and evidence behind this model.

          BenchmarkBucketScoreHarnessEvidenceSource-recorded date
          AA-Briefcase (Elo) · source release snapshot; version not specifiedSupporting evidence1260
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: AA-Briefcase (Elo) · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          AA-LCR · source release snapshot; version not specifiedLong context71.3%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          Reviewed 2026-09-12
          Agents' Last Exam · source release snapshot; version not specifiedSupporting evidence20.4%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites official Agents Last Exam leaderboard; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: Agents' Last Exam · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          Agents' Last Exam · source release snapshot; version not specifiedSupporting evidence23.8%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: Agents' Last Exam · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          Agents' Last Exam (ALE-CLI) · source release snapshot; version not specifiedSupporting evidence23.8%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: Agents' Last Exam (ALE-CLI) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          APEX-Agents · source release snapshot; version not specifiedAgentic35.6%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis / APEX-Agents leaderboard; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: APEX-Agents · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Kimi K3 Evaluation Details cites Artificial Analysis / APEX-Agents leaderboard; retain as published context, not a new Moonshot comparison.

          Reviewed 2026-09-12
          ARC-AGI-2Hard reasoning22.8%ARC Prize verified

          Effort: Not specified

          contributes to capability
          official board2026-06-13
          AutomationBench · source release snapshot; version not specifiedAgentic12.9%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

          Published configuration

          Effort: Max

          contributes to capability
          lab self-reportReviewed 2026-09-12
          AutomationBench (Public) · source release snapshot; version not specifiedAgentic12.9%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          AutomationBench (v1.0.6) · v1.0.6Agentic26.2%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: AutomationBench (v1.0.6) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          CorpFin v2 · source release snapshot; version not specifiedSupporting evidence66.1%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Vals AI; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: CorpFin v2 · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          CritPt · source release snapshot; version not specifiedSupporting evidence20.9%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: CritPt · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          CyberGym · source release snapshot; version not specifiedSupporting evidence77.2%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: CyberGym · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          DeepSWE · source release snapshot; version not specifiedCoding46.2%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: DeepSWE · reviewed 2026-09-12

          Published configuration

          Effort: Max

          contributes to capability
          lab self-reportReviewed 2026-09-12
          DeepSWE · source release snapshot; version not specifiedCoding46.2%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: DeepSWE · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          DeepSWE (v1.1) · v1.1Coding46.2%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: DeepSWE (v1.1) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          DeepSWE v1.1Coding43.8%DeepSWE v1.1 reported

          Effort: Not specified

          contributes to capability
          official board2026-09-03
          DSBench-FullStack † · source release snapshot; version not specifiedSupporting evidence61.8%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result. † source footnote applies.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: DSBench-FullStack † · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          DSBench-Hard † · source release snapshot; version not specifiedSupporting evidence54.5%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result. † source footnote applies.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: DSBench-Hard † · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          ExploitBench · source release snapshot; version not specifiedSupporting evidence24.4%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: ExploitBench · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          ExploitGym (2h / 6h) · source release snapshot; version not specifiedSupporting evidence29 count
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. 2h Single-run869tasks; API time normalized by model TPS plus overhead; reported number solved; domain whitelist.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: ExploitGym (2h / 6h) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          ExploitGym (2h / 6h) · source release snapshot; version not specifiedSupporting evidence39 count
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. 6h Single-run869tasks; API time normalized by model TPS plus overhead; reported number solved; domain whitelist.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: ExploitGym (2h / 6h) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          Finance Agent v2 · source release snapshot; version not specifiedSupporting evidence49.7%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Vals AI; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: Finance Agent v2 · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          FrontierSWE · source release snapshot; version not specifiedSupporting evidence67.3%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites FrontierSWE leaderboard; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: FrontierSWE · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          FrontierSWE · source release snapshot; version not specifiedSupporting evidence67.5%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          Externally evaluated result, attributed in the source footnote.

          Comparison limit: The GLM card attributes this evaluation to Proximal; it is not a new Z.ai comparison.

          zai-org/GLM-5.3 · Performance table: FrontierSWE · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          GDPval-AA v2 · source release snapshot; version not specifiedAgentic1508
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          Externally evaluated result, attributed in the source footnote.

          Comparison limit: The GLM card attributes this evaluation to Artificial Analysis; it is not a new Z.ai comparison.

          zai-org/GLM-5.3 · Performance table: GDPval-AA v2 · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          The GLM card attributes this evaluation to Artificial Analysis; it is not a new Z.ai comparison.

          Reviewed 2026-09-12
          GDPval-AA v2 (Elo) · source release snapshot; version not specifiedAgentic1510
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: GDPval-AA v2 (Elo) · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          Reviewed 2026-09-12
          GPQA Diamond · source release snapshot; version not specifiedHard reasoning91.2%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: GPQA Diamond · reviewed 2026-09-12

          Published configuration

          Effort: Max

          contributes to capability
          lab self-reportReviewed 2026-09-12
          Harvey Lab-AA · source release snapshot; version not specifiedSupporting evidence91%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: Harvey Lab-AA · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          HLE (wo / w tools) · source release snapshot; version not specifiedHard reasoning40.5%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. without tools

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: HLE (wo / w tools) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          HLE (wo / w tools) · source release snapshot; version not specifiedHard reasoning54.7%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. with tools

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: HLE (wo / w tools) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          HLE w/ Tools · source release snapshot; version not specifiedHard reasoning54.7%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: HLE w/ Tools · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          JobBench · source release snapshot; version not specifiedSupporting evidence43.4%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: JobBench · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          Kimi Code Bench 2.0 · 2.0Supporting evidence64.2%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: Kimi Code Bench 2.0 · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          Legal Research Bench · source release snapshot; version not specifiedSupporting evidence31.3%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Vals AI; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: Legal Research Bench · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          MCP-Atlas · source release snapshot; version not specifiedAgentic82.6%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: MCP-Atlas · reviewed 2026-09-12

          Published configuration

          Effort: Max

          contributes to capability
          lab self-reportReviewed 2026-09-12
          MLS-Bench-Lite · source release snapshot; version not specifiedSupporting evidence40.4%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: MLS-Bench-Lite · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          NL2Repo · source release snapshot; version not specifiedSupporting evidence48.9%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: NL2Repo · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          NL2Repo · source release snapshot; version not specifiedSupporting evidence48.9%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          OfficeQA Pro · source release snapshot; version not specifiedAgentic41.4%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: OfficeQA Pro · reviewed 2026-09-12

          Published configuration

          Effort: Max

          contributes to capability
          lab self-reportReviewed 2026-09-12
          PostTrainBench · source release snapshot; version not specifiedSupporting evidence34.3%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites official PostTrainBench results; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: PostTrainBench · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          PostTrainBench · source release snapshot; version not specifiedSupporting evidence31.7%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: PostTrainBench · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          ProgramBench · source release snapshot; version not specifiedSupporting evidence63.7%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites GLM release blog or Vals AI, per model; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: ProgramBench · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          ProgramBench (Almost Solved) · source release snapshot; version not specifiedSupporting evidence9.5%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: ProgramBench (Almost Solved) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          ResearchRubrics · source release snapshot; version not specifiedSupporting evidence71.1%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: ResearchRubrics · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          SciCode · source release snapshot; version not specifiedCoding50.5%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: SciCode · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          Reviewed 2026-09-12
          SpreadsheetBench 2 · source release snapshot; version not specifiedSupporting evidence28.1%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: SpreadsheetBench 2 · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          SWE-Marathon · source release snapshot; version not specifiedSupporting evidence13%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites GLM-5.2 release blog; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: SWE-Marathon · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          SWE-Marathon (v1.1) · v1.1Supporting evidence19.4%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: SWE-Marathon (v1.1) · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          Terminal Bench 2.1 · 2.1Coding81%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: Terminal Bench 2.1 · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          Terminal Bench 2.1 · 2.1Coding81%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: Terminal Bench 2.1 · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          Terminal Bench 3.0 · 3.0Coding4.6%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: Terminal Bench 3.0 · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          Terminal-Bench 2.1 · 2.1Coding82.7%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites GLM release blog, Artificial Analysis or OpenAI, per model; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: Terminal-Bench 2.1 · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Kimi K3 Evaluation Details cites GLM release blog, Artificial Analysis or OpenAI, per model; retain as published context, not a new Moonshot comparison.

          Reviewed 2026-09-12
          Toolathlon Verified · source release snapshot; version not specifiedAgentic59.9%
          Reported settings & source

          GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

          First-party reported result.

          zai-org/GLM-5.3 · Performance table: Toolathlon Verified · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          Toolathlon-Verified · source release snapshot; version not specifiedAgentic59.9%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          First-party reported result.

          moonshotai/Kimi-K3 · Performance table: Toolathlon-Verified · reviewed 2026-09-12

          Published configuration

          Effort: Max

          contributes to capability
          lab self-reportReviewed 2026-09-12
          Toolathlon-Verified · source release snapshot; version not specifiedAgentic59.9%
          Reported settings & source

          DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card.

          First-party reported result.

          deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: Toolathlon-Verified · reviewed 2026-09-12

          Published configuration

          Effort: Not specified

          contributes to capability
          lab self-reportReviewed 2026-09-12
          τ³-Banking · source release snapshot; version not specifiedSupporting evidence26.8%
          Reported settings & source

          Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

          Cited result; see benchmark-specific Evaluation Details.

          Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

          moonshotai/Kimi-K3 · Performance table: τ³-Banking · reviewed 2026-09-12

          Published configuration

          Effort: Max

          lab self-report

          Supporting evidence outside the reviewed capability core

          Reviewed 2026-09-12
          GDPval-AAAgentic
          GPQA DiamondHard reasoning
          Humanity's Last ExamHard reasoning
          LiveCodeBenchCoding
          LMArena Text ArenaHuman pref
          MMLU-ProKnowledge
          OSWorld-VerifiedAgentic
          SWE-bench ProAgentic
          SWE-bench VerifiedAgentic
          Terminal-Bench 2.1Agentic