RankingAutomationBench · source release snapshot; version not specified

AutomationBench · source release snapshot; version not specified

Data updated 12 Sept 2026

Bucket
Agentic
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
moonshotai/Kimi-K3
Board
https://huggingface.co/moonshotai/Kimi-K3

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
Kimi K3Moonshot30.8%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GPT-5.6 SolOpenAI29.7%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
Claude Fable 5Anthropic29.1%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
Claude Opus 4.8Anthropic27.2%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GPT-5.5OpenAI22.7%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GLM-5.2Z.ai12.9%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

First-party reported result.

moonshotai/Kimi-K3 · Performance table: AutomationBench · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12