Claude Opus 4.8

GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. 2h Single-run869tasks; API time normalized by model TPS plus overhead; reported number solved; domain whitelist.

First-party reported result.

zai-org/GLM-5.3 · Performance table: ExploitGym (2h / 6h) · reviewed 2026-10-18

GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. 6h Single-run869tasks; API time normalized by model TPS plus overhead; reported number solved; domain whitelist.

First-party reported result.

zai-org/GLM-5.3 · Performance table: ExploitGym (2h / 6h) · reviewed 2026-10-18

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Vals AI; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: Finance Agent v2 · reviewed 2026-10-18

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Academic table / FrontierMath Tier 1-3 (v2) / Claude Opus 4.8 · reviewed 2026-09-06

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Academic table / FrontierMath Tier 4 (v2) / Claude Opus 4.8 · reviewed 2026-09-06

Source benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card.

Cited comparator result; see the benchmark footnote.

Comparison limit: The Qwen card cites an external leaderboard or release report for this comparator; it is not a new Qwen evaluation. Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall.

Qwen/Qwen3.8-2.4T-A95B · Performance table: FrontierSWE · reviewed 2026-10-18

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites FrontierSWE leaderboard; retain as published context, not a new Moonshot comparison. Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall.

moonshotai/Kimi-K3 · Performance table: FrontierSWE · reviewed 2026-10-18

GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

Externally evaluated result, attributed in the source footnote.

Comparison limit: The GLM card attributes this evaluation to Proximal; it is not a new Z.ai comparison. Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall.

zai-org/GLM-5.3 · Performance table: FrontierSWE · reviewed 2026-10-18

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Multimodal table / gdp.pdf / Claude Opus 4.8 · reviewed 2026-09-06

GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details.

Externally evaluated result, attributed in the source footnote.

Comparison limit: The GLM card attributes this evaluation to Artificial Analysis; it is not a new Z.ai comparison.

zai-org/GLM-5.3 · Performance table: GDPval-AA v2 · reviewed 2026-10-18

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Professional table / GDPval-AA v2 / Claude Opus 4.8 · reviewed 2026-09-06

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: GDPval-AA v2 (Elo) · reviewed 2026-10-18

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Science And Health table / GeneBench Pro / Claude Opus 4.8 · reviewed 2026-09-06

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Academic table / GPQA Diamond / Claude Opus 4.8 · reviewed 2026-09-06

Source benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card.

First-party reported result.

Qwen/Qwen3.8-2.4T-A95B · Performance table: GPQA Diamond · reviewed 2026-10-18

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: GPQA Diamond · reviewed 2026-10-18

Launch table reported configuration; per-cell reasoning effort unspecified; BFS 1mil f1

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Long Context table / GraphWalks BFS 1mil f1 / Claude Opus 4.8 · reviewed 2026-09-06

Launch table reported configuration; per-cell reasoning effort unspecified; BFS 256k f1

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Long Context table / GraphWalks BFS 256k f1 / Claude Opus 4.8 · reviewed 2026-09-06

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: Harvey Lab-AA · reviewed 2026-10-18

Source benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card.

First-party reported result.

Qwen/Qwen3.8-2.4T-A95B · Performance table: HealthBench · reviewed 2026-10-18

Launch table reported configuration; per-cell reasoning effort unspecified; official paper scoring; length-adjusted

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Science And Health table / HealthBench Professional / Claude Opus 4.8 · reviewed 2026-09-06

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Source benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card.

First-party reported result.

Qwen/Qwen3.8-2.4T-A95B · Performance table: HLE · reviewed 2026-10-18