RankingToolathlon-Verified (official board)

Toolathlon-Verified (official board)

Data updated 6 Oct 2026

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
2026-10-05
Display harness
Toolathlon-Verified Default agent
Board
https://toolathlon.xyz/docs/leaderboard

Toolathlon-Verified is the June 30, 2026 score series. These rows are the official board's headline Pass@1 on the shared Default agent. They do not enter the weighted Overall or capability scores.

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

76–100 of 460 entries

ModelScoreEvidenceSource-recorded date
Command R Plus 08 2024Cohere———
Command R7B 12 2024Cohere———
DeepSeek V4 Flash 0424DeepSeek———
DeepSeek V4-Pro 0424DeepSeek———
DeepSeek V4.1 FlashDeepSeek———
DeepSeek-R1-0528DeepSeek———
DeepSeek-R1-0528-Qwen3-8BDeepSeek———
DeepSeek-R1-Distill-Llama-70BDeepSeek———
DeepSeek-R1-Distill-Llama-8BDeepSeek———
DeepSeek-R1-Distill-Qwen-1.5BDeepSeek———
DeepSeek-R1-Distill-Qwen-14BDeepSeek———
DeepSeek-R1-Distill-Qwen-32BDeepSeek———
DeepSeek-R1-Distill-Qwen-7BDeepSeek———
DeepSeek-V3.2DeepSeek———
DeepSeek-V3.2-SpecialeDeepSeek———
DeepSeek-V4-Flash-Vision-ExpDeepSeek———
Devstral 2Mistral———
Devstral Medium 1.0Mistral———
Devstral Small 1.1Mistral———
Devstral Small 2Mistral———
DiffusionGemma 26B A4BGoogle———
Doubao Seed CodeByteDance———
ERNIE-4.5-0.3B-PTBaidu———
ERNIE-4.5-21B-A3B-PTBaidu———
ERNIE-4.5-21B-A3B-ThinkingBaidu———