RankingAA-LCR · source release snapshot; version not specified

AA-LCR · source release snapshot; version not specified

Data updated 12 Sept 2026

Bucket
Long context
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
moonshotai/Kimi-K3
Board
https://huggingface.co/moonshotai/Kimi-K3

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
Kimi K3Moonshot74.7%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GPT-5.5OpenAI74.3%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GPT-5.6 SolOpenAI73.7%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GLM-5.2Z.ai71.3%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
Claude Fable 5Anthropic70%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
Claude Opus 4.8Anthropic67.7%
Reported settings & source

Table headers: Kimi K3, GPT-5.6 Sol, Opus 4.8 and GLM-5.2 max; GPT-5.5 xhigh; Fable 5 max with fallbacks. Benchmark-specific footnotes override header settings; cited results are not new Moonshot evaluations. Benchmark-specific tools, harness and budget documented under Evaluation Details. Kimi temp1; single-step top_p.95,agentic top_p1; vision tools=Python,3runs except ZeroBench5runs.

Cited result; see benchmark-specific Evaluation Details.

Comparison limit: Kimi K3 Evaluation Details cites Artificial Analysis; retain as published context, not a new Moonshot comparison.

moonshotai/Kimi-K3 · Performance table: AA-LCR · reviewed 2026-09-12

moonshotai/Kimi-K3lab self-report2026-09-12
GLM-5.1Z.ai66.9%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 66.9

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: AA-LCR · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06
Kimi-K2.6Moonshot70.2%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 70.2

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: AA-LCR · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06
MiniMax-M2.7MiniMax69.8%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 69.8

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: AA-LCR · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06
NVIDIA Nemotron 3 UltraNVIDIA65.4%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 65.4 The linked NVIDIA reproduction recipe explicitly enables thinking for this model and benchmark. It does not establish Low/Medium/High/Max or a fixed reasoning-token budget; the request adapter removes max_tokens and max_completion_tokens. Comparator settings are not specified by this recipe.

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: AA-LCR · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06
Qwen3.5-397B-A17BQwen68.3%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 68.3

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: AA-LCR · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06