Evidence coverage

2666 published observations across 285 measures. Capability scoring groups compatible evidence into 43 benchmark families.

A published result contributes only when a matching reference-panel result is available. Missing evidence stays unknown. Coverage describes breadth, separately from performance.

Coverage across our labs

LabModels with resultsPublished measuresLaunch sources
OpenAI31 / 3720916
Anthropic11 / 1121717
xAI3 / 7181
Google21 / 341098
Meta11 / 14332
Mistral16 / 27151
Moonshot3 / 71197
Qwen28 / 81914
DeepSeek4 / 15282
NVIDIA2 / 10411
Z.ai17 / 52937
MiniMax6 / 13642
Cohere10 / 26181
Amazon5 / 6191
Microsoft9 / 24191
Xiaomi3 / 1130
StepFun2 / 420
LG AI Research5 / 1330
Upstage4 / 820
ByteDance1 / 1610
Tencent1 / 1320
Baidu1 / 2010
OpenBMB1 / 110
Agnes AI1 / 110

Models and contributing families

Raw published counts include all source types. Contributing and independent family counts follow the selected evidence policy.

451 models match.

ModelPublished measuresContributing familiesWith independent supportExplore
Llama-3.2-1B-Instruct111Published results
Llama-3.2-3B-Instruct111Published results
Magistral Small 1.2111Published results
MiMo-7B-RL111Published results
MiniCPM5-2B111Published results
MiniMax-M2.1111Published results
MiniMax-Text-01111Published results
Ministral 3 14B111Published results
Ministral 3 3B111Published results
Ministral 3 8B111Published results
Ministral 8B111Published results
Mistral Large 2 (July 2024)111Published results
Mistral Large 2.1111Published results
Mistral Small 4510Published results
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16111Published results
o3-pro111Published results
Phi-3-medium-4k-instruct111Published results
Phi-3-mini-128k-instruct111Published results
Phi-3-mini-4k-instruct111Published results
Phi-3-small-8k-instruct111Published results
Phi-3.5-mini-instruct111Published results
Phi-4-reasoning111Published results
Phi-4-reasoning-plus111Published results
Qwen3-30B-A3B111Published results
Qwen3-30B-A3B-Instruct-2507111Published results

Family coverage

Benchmark familyCapabilityModels contributingWith independent support
OSWorldAgentic196
Webarena VerifiedAgentic40
BrowsecompAgentic220
ToolathlonAgentic150
MCP-AtlasAgentic190
AutomationBenchAgentic190
DeepSearchQAAgentic100
GDPvalAgentic6041
Bfcl V4Agentic120
Apex AgentsAgentic100
OfficeQAAgentic110
Humanity’s Last ExamHard reasoning318
GPQAHard reasoning4823
ARC-AGIHard reasoning4848
AimeHard reasoning220
FrontierMathHard reasoning100
Imo AnswerbenchHard reasoning50
Terminal-Bench ScienceHard reasoning50
SWE-bench VerifiedCoding3819
SWE-bench ProCoding204
SWE-bench MultilingualCoding90
DeepSWECoding3128
LiveCodeBenchCoding259
Terminal-BenchCoding412
ScicodeCoding70
Human preference (Arena)Human pref115115
MMLU-ProKnowledge6852
GmmluKnowledge30
MiluKnowledge30
Simpleqa VerifiedKnowledge20
MmmuMultimodal20
Mmmu ProMultimodal240
CharXivMultimodal160
MathvistaMultimodal20
ChartographyMultimodal30
LvbenchMultimodal60
ScreenSpotMultimodal120
Ocrbench V2 Average AccuracyMultimodal120
MRCRLong context120
LongbenchLong context80
Ruler 1MLong context20
GraphwalksLong context70
Aa LcrLong context50
Model evidence matrix

Showing the same 151–175 models as the list above.

ModelOSWorldWebarena VerifiedBrowsecompToolathlonMCP-AtlasAutomationBenchDeepSearchQAGDPvalBfcl V4Apex AgentsOfficeQAHumanity’s Last ExamGPQAARC-AGIAimeFrontierMathImo AnswerbenchTerminal-Bench ScienceSWE-bench VerifiedSWE-bench ProSWE-bench MultilingualDeepSWELiveCodeBenchTerminal-BenchScicodeHuman preference (Arena)MMLU-ProGmmluMiluSimpleqa VerifiedMmmuMmmu ProCharXivMathvistaChartographyLvbenchScreenSpotOcrbench V2 Average AccuracyMRCRLongbenchRuler 1MGraphwalksAa Lcr
Llama-3.2-1B-InstructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown2.6
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Llama-3.2-3B-InstructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown7.0
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Magistral Small 1.2UnknownUnknownUnknownUnknownUnknownUnknownUnknown10.0
Independent support · 40/40 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
MiMo-7B-RLUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown25.5
Independent support · 51/51 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
MiniCPM5-2BUnknownUnknownUnknownUnknownUnknownUnknownUnknown47.5
Independent support · 40/40 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
MiniMax-M2.1UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown98.0
Independent support · 51/51 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
MiniMax-Text-01UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown51.0
Independent support · 51/51 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Ministral 3 14BUnknownUnknownUnknownUnknownUnknownUnknownUnknown20.0
Independent support · 40/40 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Ministral 3 3BUnknownUnknownUnknownUnknownUnknownUnknownUnknown12.5
Independent support · 40/40 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Ministral 3 8BUnknownUnknownUnknownUnknownUnknownUnknownUnknown17.5
Independent support · 40/40 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Ministral 8BUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown14.9
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Mistral Large 2 (July 2024)UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown24.6
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Mistral Large 2.1UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown23.7
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Mistral Small 4UnknownUnknown100.0
Provider reports · 2/2 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown25.4
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
o3-proUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown31.9
Independent support · 47/47 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-3-medium-4k-instructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown9.6
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-3-mini-128k-instructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown5.3
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-3-mini-4k-instructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown4.4
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-3-small-8k-instructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown7.9
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-3.5-mini-instructUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown15.7
Independent support · 51/51 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-4-reasoningUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown48.0
Independent support · 51/51 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Phi-4-reasoning-plusUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown52.9
Independent support · 51/51 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Qwen3-30B-A3BUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown30.7
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown
Qwen3-30B-A3B-Instruct-2507UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown44.7
Independent support · 114/114 reference peers
UnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknownUnknown

Family definitions and scoring rules · Compare capabilities · Compare published evidence