RankingToolathlon-Verified (official board)

Toolathlon-Verified (official board)

Data updated 22 Nov 2026

Toolathlon-Verified (official board) is published here as its own result table, version 2026-10-05. Scores use percent, and higher values rank better. The display harness is Toolathlon-Verified Default agent. Data updated 22 Nov 2026.

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
2026-10-05
Display harness
Toolathlon-Verified Default agent
Board
https://toolathlon.xyz/docs/leaderboard

Toolathlon-Verified is the June 30, 2026 score series. These rows are the official board's headline Pass@1 on the shared Default agent. They do not enter the weighted Overall or capability scores.

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

301–325 of 593 entries

ModelScoreEvidenceSource-recorded date
Hy4-previewTencent———
K EXAONE 2.0 750B A37BLG AI Research———
K EXAONE 236B A23BLG AI Research———
Kimi K2Moonshot———
Kimi K2 0905Moonshot———
Kimi K2 ThinkingMoonshot———
Kimi K2.5Moonshot———
Kimi-Dev-72BMoonshot———
Kimi-Linear-48B-A3B-InstructMoonshot———
Kimi-VL-A3B-InstructMoonshot———
Kimi-VL-A3B-Thinking-2506Moonshot———
Leanstral 1.5Mistral———
Llama 2 Chat 13BMeta———
Llama 2 Chat 70BMeta———
Llama 2 Chat 7BMeta———
Llama 3 Instruct 70BMeta———
Llama 3 Instruct 8BMeta———
Llama 3.1 Instruct 405BMeta———
Llama 3.1 Instruct 70BMeta———
Llama 3.1 Instruct 8BMeta———
Llama 3.1 Nemotron Instruct 70BNVIDIA———
Llama 3.1 Nemotron Nano 4B v1.1NVIDIA———
Llama 3.1 Nemotron Ultra 253B v1NVIDIA———
Llama 3.2 Instruct 11BMeta———
Llama 3.2 Instruct 1BMeta———