RankingHumanity's Last Exam

Humanity's Last Exam

Data updated 22 Oct 2026

Bucket
Hard reasoning
Unit
percent
Direction
Higher is better
Version
full
Display harness
HLE no tools
Board
https://lastexam.ai/

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

1–25 of 471 entries

ModelScoreEvidenceSource-recorded date
Claude Fable 5.1Anthropic60.9%lab self-report

Table8.1.A and section8.12.1: full2500-question HLE, reasoning-only no-tools, adaptive/auto thinking, maximum effort,1M token cap, no compaction, Opus4.6 grader; trials averaged. Production safeguards may route flagged Fable tasks to Opus models; this is disclosed deployed-model behavior, not an unsafeguarded base-model score.

2026-09-01
Claude Fable 5Anthropic57.8%lab self-report

Table8.1.A and section8.12.1: full2500-question HLE, reasoning-only no-tools, adaptive/auto thinking, maximum effort,1M token cap, no compaction, Opus4.6 grader; trials averaged. Production safeguards may route flagged Fable tasks to Opus models; this is disclosed deployed-model behavior, not an unsafeguarded base-model score.

2026-09-01
Claude Opus 5Anthropic56.6%lab self-report

Table8.1.A and section8.12.1: full2500-question HLE, reasoning-only no-tools, adaptive/auto thinking, maximum effort,1M token cap, no compaction, Opus4.6 grader; trials averaged.

2026-09-01
Gemini 3.1 ProGoogle46.44%official board2026-04-10
Gemini 3.8 FlashGoogle44.52%official board2026-09-09
Qwen 3.8-MaxQwen43.6%lab self-report

Cited Qwen page returned no readable content in this audit; exact model/version, value and protocol could not be independently verified from that source.

2026-08-03
Kimi K3Moonshot43.5%lab self-report

No-tools label alone does not verify full2500-task subset, evaluation configuration and exact observation against the preferred unit.

2026-07-16
DeepSeek V4-Pro 0813DeepSeek42.7%lab self-report

No-tools label alone does not verify full2500-task subset, evaluation configuration and exact observation against the preferred unit.

2026-08-13
Claude Opus 4.7Anthropic36.2%official board2026-04-22
Claude Haiku 5.5Anthropic30.12%official board2026-10-08
NVIDIA Nemotron 3 UltraNVIDIA26.7%lab self-report

Fixture value corresponds to source BF16 column on the NVFP4 repository page; preserve checkpoint/precision and per-benchmark NeMo configuration before mapping to a preferred unit.

2026-06-04
Claude Opus 4.5Anthropic14.16%official board2025-11-26
Claude Sonnet 4.5Anthropic7.52%official board2025-10-02
Llama 4 MaverickMeta5.68%official board2025-04-10
GPT-4.1OpenAI5.4%official board2025-04-14
Mistral Medium 3Mistral4.52%official board2025-05-13
Agnes 2.5 Pro AlphaAgnes AI———
Agnes-3.0-Flash PreviewAgnes AI———
Amazon Nova 2 LiteAmazon———
Amazon Nova 2 Pro PreviewAmazon———
Amazon Nova LiteAmazon———
Amazon Nova MicroAmazon———
Amazon Nova PremierAmazon———
Amazon Nova ProAmazon———
AutoGLM-Phone-9BZ.ai———

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Claude Fable 5Anthropic63.8%HLE with toolslab self-report

Same full HLE with web search, restricted web fetch, programmatic tools and code execution. Kept separate from no-tools model capability; production safeguard fallback applies.

2026-09-01
Claude Fable 5.1Anthropic65%HLE with toolslab self-report

Same full HLE with web search, restricted web fetch, programmatic tools and code execution. Kept separate from no-tools model capability; production safeguard fallback applies.

2026-09-01
Claude Opus 5Anthropic63.6%HLE with toolslab self-report

Same full HLE with web search, restricted web fetch, programmatic tools and code execution. Kept separate from no-tools model capability.

2026-09-01
Claude Opus 5Anthropic64.7%HLE with toolslab self-report

Tool-enabled result is explicitly incompatible with the preferred no-tools unit.

2026-07-24