Evidence coverage

3498 published observations across 337 measures. Capability scoring groups compatible evidence into 44 benchmark families.

A published result contributes only when a matching reference-panel result is available. Missing evidence stays unknown. Coverage describes breadth, separately from performance.

Coverage across our labs

Lab	Models with results	Published measures	Launch sources
OpenAI	34 / 40	241	20
Anthropic	14 / 14	251	22
xAI	4 / 8	35	2
Google	22 / 35	133	9
Meta	14 / 16	46	2
Mistral	17 / 28	39	2
Moonshot	3 / 7	133	7
Qwen	32 / 82	104	4
DeepSeek	7 / 16	33	2
NVIDIA	2 / 10	47	1
Z.ai	17 / 52	105	7
MiniMax	6 / 14	69	2
Cohere	10 / 26	18	1
Amazon	5 / 6	20	1
Microsoft	9 / 24	19	1
Xiaomi	5 / 14	10	0
StepFun	3 / 5	5	0
LG AI Research	5 / 13	3	0
Upstage	5 / 9	4	0
ByteDance	1 / 16	1	0
Tencent	2 / 13	7	0
Baidu	1 / 20	1	0
OpenBMB	1 / 1	2	0
Agnes AI	1 / 2	2	0

Models and contributing families

Raw published counts include all source types. Contributing and independent family counts follow the selected evidence policy.

471 models match.

Model	Published measures	Contributing families	With independent support	Explore
GPT-5.6 Sol	169	26	6	Published results
Claude Fable 5	124	24	4	Published results
Claude Opus 4.8	113	23	4	Published results
Gemini 3.1 Pro	92	23	7	Published results
GPT-5.5	113	23	3	Published results
Claude Opus 5	78	22	7	Published results
GPT-5.6 Terra	61	18	4	Published results
Kimi-K2.6	69	17	1	Published results
Claude Fable 5.1	66	16	3	Published results
Claude Sonnet 4.6	41	16	4	Published results
GPT-5.6 Luna	53	15	4	Published results
Claude Sonnet 4.5	30	14	5	Published results
GLM-5.1	49	14	1	Published results
Kimi K3	81	14	5	Published results
MiniMax-M2.7	55	14	2	Published results
Qwen3.5-397B-A17B	43	14	2	Published results
GPT-6 Astra	85	13	4	Published results
NVIDIA Nemotron 3 Ultra	47	13	3	Published results
Gemini 2.5 Pro	23	12	4	Published results
Muse Spark 1.1	22	12	4	Published results
Amazon Nova 2 Lite	20	11	1	Published results
Claude Opus 4.7	34	11	2	Published results
Gemini 2.5 Flash	21	11	3	Published results
GPT-5	18	11	1	Published results
GPT-5 Mini	19	11	1	Published results

Family coverage

Benchmark family	Capability	Models contributing	With independent support
OSWorld	Agentic	21	6
Webarena Verified	Agentic	4	0
Browsecomp	Agentic	22	0
Toolathlon	Agentic	15	0
MCP-Atlas	Agentic	19	0
AutomationBench	Agentic	21	0
DeepSearchQA	Agentic	10	0
GDPval	Agentic	64	45
Bfcl V4	Agentic	12	0
Apex Agents	Agentic	10	0
OfficeQA	Agentic	11	0
GDP.pdf	Agentic	14	0
Terminal-Bench Science	Agentic	7	0
Humanity’s Last Exam	Hard reasoning	32	9
GPQA	Hard reasoning	45	18
ARC-AGI	Hard reasoning	60	60
Aime	Hard reasoning	22	0
FrontierMath	Hard reasoning	10	0
Imo Answerbench	Hard reasoning	5	0
SWE-bench Verified	Coding	38	19
SWE-bench Pro	Coding	20	4
SWE-bench Multilingual	Coding	9	0
DeepSWE	Coding	33	28
LiveCodeBench	Coding	25	9
Terminal-Bench	Coding	22	22
Scicode	Coding	0	0
Human preference (Arena)	Human pref	119	119
MMLU-Pro	Knowledge	68	52
Gmmlu	Knowledge	3	0
Milu	Knowledge	3	0
Simpleqa Verified	Knowledge	2	0
Mmmu	Multimodal	2	0
Mmmu Pro	Multimodal	24	0
CharXiv	Multimodal	16	0
Mathvista	Multimodal	2	0
Chartography	Multimodal	3	0
Lvbench	Multimodal	6	0
ScreenSpot	Multimodal	12	0
Ocrbench V2 Average Accuracy	Multimodal	12	0
MRCR	Long context	12	0
Longbench	Long context	8	0
Ruler 1M	Long context	2	0
Graphwalks	Long context	7	0
Aa Lcr	Long context	5	0

Model evidence matrix

Showing the same 1–25 models as the list above.

Model	OSWorld	Webarena Verified	Browsecomp	Toolathlon	MCP-Atlas	AutomationBench	DeepSearchQA	GDPval	Bfcl V4	Apex Agents	OfficeQA	GDP.pdf	Terminal-Bench Science	Humanity’s Last Exam	GPQA	ARC-AGI	Aime	FrontierMath	Imo Answerbench	SWE-bench Verified	SWE-bench Pro	SWE-bench Multilingual	DeepSWE	LiveCodeBench	Terminal-Bench	Scicode	Human preference (Arena)	MMLU-Pro	Gmmlu	Milu	Simpleqa Verified	Mmmu	Mmmu Pro	CharXiv	Mathvista	Chartography	Lvbench	ScreenSpot	Ocrbench V2 Average Accuracy	MRCR	Longbench	Ruler 1M	Graphwalks	Aa Lcr
GPT-5.6 Sol	33.3 Provider reports · 9/9 reference peers	Unknown	66.7 Provider reports · 8/8 reference peers	60.0 Provider reports · 12/12 reference peers	50.0 Provider reports · 5/5 reference peers	57.1 Provider reports · 16/16 reference peers	100.0 Provider reports · 2/2 reference peers	47.9 Independent support · 54/54 reference peers	Unknown	33.3 Provider reports · 3/3 reference peers	40.0 Provider reports · 5/5 reference peers	100.0 Provider reports · 10/10 reference peers	25.0 Provider reports · 4/4 reference peers	85.6 Provider reports · 14/14 reference peers	85.0 Independent support · 20/20 reference peers	65.0 Independent support · 59/59 reference peers	Unknown	68.3 Provider reports · 9/9 reference peers	Unknown	Unknown	33.3 Provider reports · 10/10 reference peers	Unknown	79.2 Independent support · 30/30 reference peers	Unknown	52.4 Independent support · 21/21 reference peers	Unknown	100.0 Independent support · 41/41 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	93.8 Provider reports · 7/7 reference peers	48.8 Provider reports · 9/9 reference peers	Unknown	Unknown	33.3 Provider reports · 3/3 reference peers	0.0 Provider reports · 1/1 reference peers	Unknown	47.2 Provider reports · 8/8 reference peers	66.7 Provider reports · 3/3 reference peers	Unknown	100.0 Provider reports · 4/4 reference peers	Unknown
Claude Fable 5	66.7 Independent support · 10/10 reference peers	Unknown	0.0 Provider reports · 3/3 reference peers	100.0 Provider reports · 8/8 reference peers	100.0 Provider reports · 5/5 reference peers	33.9 Provider reports · 11/11 reference peers	50.0 Provider reports · 2/2 reference peers	66.7 Provider reports · 11/11 reference peers	Unknown	100.0 Provider reports · 3/3 reference peers	100.0 Provider reports · 5/5 reference peers	83.3 Provider reports · 6/6 reference peers	0.0 Provider reports · 4/4 reference peers	72.2 Provider reports · 7/7 reference peers	28.3 Provider reports · 12/12 reference peers	59.8 Independent support · 59/59 reference peers	Unknown	86.1 Provider reports · 9/9 reference peers	Unknown	Unknown	83.3 Provider reports · 8/8 reference peers	0.0 Provider reports · 2/2 reference peers	70.9 Independent support · 28/28 reference peers	Unknown	37.1 Independent support · 21/21 reference peers	Unknown	Unknown	Unknown	50.0 Provider reports · 2/2 reference peers	50.0 Provider reports · 2/2 reference peers	Unknown	Unknown	68.8 Provider reports · 4/4 reference peers	100.0 Provider reports · 4/4 reference peers	Unknown	50.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown
Claude Opus 4.8	70.8 Provider reports · 8/8 reference peers	100.0 Provider reports · 3/3 reference peers	20.0 Provider reports · 5/5 reference peers	83.6 Provider reports · 14/14 reference peers	58.3 Provider reports · 7/7 reference peers	44.7 Provider reports · 13/13 reference peers	16.7 Provider reports · 5/5 reference peers	85.7 Provider reports · 8/8 reference peers	Unknown	Unknown	80.0 Provider reports · 5/5 reference peers	16.7 Provider reports · 6/6 reference peers	Unknown	63.3 Provider reports · 12/12 reference peers	0.0 Provider reports · 10/10 reference peers	66.9 Independent support · 59/59 reference peers	Unknown	16.7 Provider reports · 6/6 reference peers	Unknown	Unknown	94.4 Provider reports · 9/9 reference peers	Unknown	43.1 Independent support · 28/28 reference peers	Unknown	42.9 Independent support · 21/21 reference peers	Unknown	86.8 Independent support · 76/76 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	62.5 Provider reports · 6/6 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 3/3 reference peers	100.0 Provider reports · 3/3 reference peers	Unknown	62.5 Provider reports · 4/4 reference peers	Unknown
Gemini 3.1 Pro	30.0 Provider reports · 7/7 reference peers	50.0 Provider reports · 3/3 reference peers	80.0 Provider reports · 11/11 reference peers	0.0 Provider reports · 7/7 reference peers	38.1 Provider reports · 9/9 reference peers	Unknown	0.0 Provider reports · 3/3 reference peers	11.9 Independent support · 53/53 reference peers	Unknown	60.0 Provider reports · 5/5 reference peers	0.0 Provider reports · 3/3 reference peers	0.0 Provider reports · 6/6 reference peers	Unknown	58.3 Independent support · 11/11 reference peers	83.3 Provider reports · 6/6 reference peers	48.9 Independent support · 59/59 reference peers	Unknown	0.0 Provider reports · 6/6 reference peers	Unknown	66.7 Provider reports · 6/6 reference peers	0.0 Independent support · 14/14 reference peers	100.0 Provider reports · 1/1 reference peers	0.0 Independent support · 27/27 reference peers	Unknown	Unknown	Unknown	93.4 Independent support · 76/76 reference peers	100.0 Independent support · 51/51 reference peers	Unknown	Unknown	Unknown	Unknown	68.3 Provider reports · 8/8 reference peers	0.0 Provider reports · 5/5 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown
GPT-5.5	37.4 Provider reports · 12/12 reference peers	0.0 Provider reports · 3/3 reference peers	62.9 Provider reports · 11/11 reference peers	34.4 Provider reports · 9/9 reference peers	35.2 Provider reports · 13/13 reference peers	10.0 Provider reports · 8/8 reference peers	100.0 Provider reports · 3/3 reference peers	65.1 Provider reports · 14/14 reference peers	Unknown	100.0 Provider reports · 5/5 reference peers	60.0 Provider reports · 8/8 reference peers	66.7 Provider reports · 6/6 reference peers	Unknown	8.3 Provider reports · 6/6 reference peers	68.3 Provider reports · 8/8 reference peers	66.5 Independent support · 59/59 reference peers	Unknown	63.3 Provider reports · 6/6 reference peers	Unknown	83.3 Provider reports · 6/6 reference peers	36.1 Provider reports · 12/12 reference peers	Unknown	59.1 Independent support · 27/27 reference peers	Unknown	Unknown	Unknown	89.5 Independent support · 76/76 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	67.4 Provider reports · 11/11 reference peers	22.9 Provider reports · 6/6 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	83.3 Provider reports · 5/5 reference peers	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown
Claude Opus 5	63.7 Independent support · 9/9 reference peers	Unknown	66.7 Provider reports · 3/3 reference peers	Unknown	Unknown	72.2 Provider reports · 5/5 reference peers	50.0 Provider reports · 2/2 reference peers	91.7 Independent support · 49/49 reference peers	Unknown	Unknown	0.0 Provider reports · 1/1 reference peers	80.0 Provider reports · 5/5 reference peers	50.0 Provider reports · 4/4 reference peers	31.1 Provider reports · 8/8 reference peers	65.0 Independent support · 6/6 reference peers	69.4 Independent support · 59/59 reference peers	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	Unknown	33.3 Provider reports · 3/3 reference peers	100.0 Provider reports · 2/2 reference peers	76.3 Independent support · 28/28 reference peers	Unknown	72.7 Independent support · 21/21 reference peers	Unknown	97.4 Independent support · 76/76 reference peers	Unknown	0.0 Provider reports · 2/2 reference peers	0.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	20.0 Provider reports · 5/5 reference peers	Unknown	0.0 Provider reports · 2/2 reference peers	100.0 Provider reports · 1/1 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown
GPT-5.6 Terra	50.0 Provider reports · 4/4 reference peers	Unknown	80.0 Provider reports · 5/5 reference peers	16.7 Provider reports · 6/6 reference peers	Unknown	50.0 Provider reports · 6/6 reference peers	Unknown	38.6 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	35.0 Provider reports · 10/10 reference peers	Unknown	20.0 Provider reports · 5/5 reference peers	50.0 Independent support · 8/8 reference peers	76.1 Independent support · 59/59 reference peers	Unknown	45.0 Provider reports · 6/6 reference peers	Unknown	Unknown	50.0 Provider reports · 6/6 reference peers	Unknown	66.0 Independent support · 27/27 reference peers	Unknown	49.0 Independent support · 21/21 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	41.7 Provider reports · 4/4 reference peers	80.0 Provider reports · 5/5 reference peers	Unknown	Unknown	0.0 Provider reports · 3/3 reference peers	Unknown	Unknown	50.0 Provider reports · 3/3 reference peers	Unknown	Unknown	50.0 Provider reports · 4/4 reference peers	Unknown
Kimi-K2.6	20.0 Provider reports · 5/5 reference peers	Unknown	78.6 Provider reports · 9/9 reference peers	Unknown	28.6 Provider reports · 7/7 reference peers	Unknown	Unknown	44.6 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 4/4 reference peers	80.0 Provider reports · 8/8 reference peers	Unknown	100.0 Provider reports · 2/2 reference peers	Unknown	100.0 Provider reports · 4/4 reference peers	58.3 Provider reports · 11/11 reference peers	79.2 Provider reports · 9/9 reference peers	50.0 Provider reports · 5/5 reference peers	Unknown	100.0 Provider reports · 5/5 reference peers	Unknown	Unknown	90.2 Independent support · 41/41 reference peers	62.5 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	30.0 Provider reports · 5/5 reference peers	50.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 4/4 reference peers
Claude Fable 5.1	100.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown	87.5 Provider reports · 4/4 reference peers	Unknown	100.0 Provider reports · 3/3 reference peers	Unknown	Unknown	100.0 Provider reports · 1/1 reference peers	Unknown	75.0 Provider reports · 4/4 reference peers	100.0 Provider reports · 3/3 reference peers	40.0 Independent support · 12/12 reference peers	52.2 Independent support · 59/59 reference peers	Unknown	50.0 Provider reports · 4/4 reference peers	Unknown	Unknown	100.0 Provider reports · 3/3 reference peers	50.0 Provider reports · 2/2 reference peers	0.0 Provider reports · 5/5 reference peers	Unknown	88.6 Independent support · 21/21 reference peers	Unknown	Unknown	Unknown	100.0 Provider reports · 2/2 reference peers	100.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown
Claude Sonnet 4.6	20.0 Independent support · 10/10 reference peers	Unknown	25.0 Provider reports · 10/10 reference peers	Unknown	14.3 Provider reports · 7/7 reference peers	Unknown	Unknown	71.4 Provider reports · 7/7 reference peers	Unknown	20.0 Provider reports · 5/5 reference peers	Unknown	Unknown	Unknown	Unknown	40.0 Provider reports · 5/5 reference peers	54.2 Independent support · 59/59 reference peers	37.5 Provider reports · 6/6 reference peers	Unknown	Unknown	36.1 Provider reports · 12/12 reference peers	Unknown	Unknown	3.7 Independent support · 27/27 reference peers	Unknown	Unknown	Unknown	85.5 Independent support · 76/76 reference peers	100.0 Provider reports · 1/1 reference peers	Unknown	Unknown	0.0 Provider reports · 1/1 reference peers	Unknown	0.0 Provider reports · 5/5 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 1/1 reference peers	Unknown	100.0 Provider reports · 1/1 reference peers	Unknown
GPT-5.6 Luna	0.0 Provider reports · 4/4 reference peers	Unknown	0.0 Provider reports · 5/5 reference peers	33.3 Provider reports · 6/6 reference peers	Unknown	33.3 Provider reports · 6/6 reference peers	Unknown	42.9 Provider reports · 7/7 reference peers	Unknown	Unknown	Unknown	33.3 Provider reports · 6/6 reference peers	Unknown	Unknown	8.3 Independent support · 7/7 reference peers	25.4 Independent support · 59/59 reference peers	Unknown	18.3 Provider reports · 6/6 reference peers	Unknown	Unknown	33.3 Provider reports · 6/6 reference peers	Unknown	58.3 Independent support · 27/27 reference peers	Unknown	23.8 Independent support · 21/21 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 3/3 reference peers	Unknown	Unknown	37.5 Provider reports · 4/4 reference peers	Unknown
Claude Sonnet 4.5	20.0 Independent support · 5/5 reference peers	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	75.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	100.0 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	37.5 Independent support · 8/8 reference peers	72.7 Provider reports · 11/11 reference peers	18.6 Independent support · 59/59 reference peers	47.7 Provider reports · 15/15 reference peers	Unknown	Unknown	65.7 Independent support · 28/28 reference peers	Unknown	Unknown	Unknown	44.4 Provider reports · 9/9 reference peers	Unknown	Unknown	87.8 Independent support · 41/41 reference peers	100.0 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	68.2 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	9.1 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown
GLM-5.1	Unknown	Unknown	70.2 Provider reports · 11/11 reference peers	Unknown	57.1 Provider reports · 7/7 reference peers	Unknown	Unknown	71.4 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	58.3 Provider reports · 4/4 reference peers	10.0 Provider reports · 8/8 reference peers	Unknown	50.0 Provider reports · 2/2 reference peers	Unknown	50.0 Provider reports · 4/4 reference peers	100.0 Provider reports · 7/7 reference peers	54.2 Provider reports · 9/9 reference peers	75.0 Provider reports · 4/4 reference peers	Unknown	50.0 Provider reports · 4/4 reference peers	Unknown	Unknown	82.9 Independent support · 76/76 reference peers	50.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	25.0 Provider reports · 4/4 reference peers
Kimi K3	62.5 Provider reports · 4/4 reference peers	Unknown	Unknown	93.3 Provider reports · 9/9 reference peers	80.0 Provider reports · 5/5 reference peers	86.1 Provider reports · 9/9 reference peers	100.0 Provider reports · 2/2 reference peers	78.6 Independent support · 42/42 reference peers	Unknown	Unknown	60.0 Provider reports · 5/5 reference peers	Unknown	Unknown	45.8 Provider reports · 9/9 reference peers	55.0 Independent support · 14/14 reference peers	54.2 Independent support · 59/59 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	79.4 Independent support · 27/27 reference peers	Unknown	Unknown	Unknown	94.7 Independent support · 76/76 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	62.5 Provider reports · 4/4 reference peers	75.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown
MiniMax-M2.7	Unknown	Unknown	32.1 Provider reports · 9/9 reference peers	Unknown	0.0 Provider reports · 7/7 reference peers	Unknown	Unknown	46.0 Independent support · 48/48 reference peers	Unknown	0.0 Provider reports · 5/5 reference peers	Unknown	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	25.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	33.3 Provider reports · 9/9 reference peers	16.7 Provider reports · 6/6 reference peers	50.0 Provider reports · 4/4 reference peers	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	Unknown	48.7 Independent support · 76/76 reference peers	0.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	75.0 Provider reports · 4/4 reference peers
Qwen3.5-397B-A17B	Unknown	Unknown	37.5 Provider reports · 7/7 reference peers	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	54.2 Provider reports · 4/4 reference peers	75.0 Provider reports · 4/4 reference peers	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	25.0 Provider reports · 4/4 reference peers	12.5 Provider reports · 7/7 reference peers	Unknown	25.0 Provider reports · 4/4 reference peers	Unknown	25.0 Provider reports · 4/4 reference peers	Unknown	Unknown	67.1 Independent support · 76/76 reference peers	98.0 Independent support · 55/55 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 1/1 reference peers	0.0 Provider reports · 1/1 reference peers	Unknown	50.0 Provider reports · 4/4 reference peers
GPT-6 Astra	100.0 Provider reports · 4/4 reference peers	Unknown	100.0 Provider reports · 3/3 reference peers	Unknown	Unknown	100.0 Provider reports · 6/6 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	85.0 Provider reports · 2/2 reference peers	100.0 Provider reports · 6/6 reference peers	0.0 Provider reports · 3/3 reference peers	100.0 Independent support · 12/12 reference peers	96.9 Independent support · 59/59 reference peers	Unknown	100.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	91.7 Independent support · 30/30 reference peers	Unknown	96.4 Independent support · 21/21 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 1/1 reference peers	Unknown	100.0 Provider reports · 1/1 reference peers	Unknown	Unknown	Unknown	Unknown
NVIDIA Nemotron 3 Ultra	Unknown	Unknown	25.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	43.5 Independent support · 45/45 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	12.5 Provider reports · 4/4 reference peers	25.0 Independent support · 5/5 reference peers	Unknown	Unknown	Unknown	75.0 Provider reports · 4/4 reference peers	0.0 Provider reports · 4/4 reference peers	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	75.0 Provider reports · 4/4 reference peers	Unknown	Unknown	82.9 Independent support · 41/41 reference peers	37.5 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 1/1 reference peers	100.0 Provider reports · 1/1 reference peers	Unknown	0.0 Provider reports · 4/4 reference peers
Gemini 2.5 Pro	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 4/4 reference peers	Unknown	Unknown	35.7 Independent support · 42/42 reference peers	18.2 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	90.9 Provider reports · 11/11 reference peers	Unknown	54.5 Provider reports · 11/11 reference peers	Unknown	Unknown	31.9 Independent support · 24/24 reference peers	Unknown	Unknown	Unknown	66.7 Provider reports · 9/9 reference peers	Unknown	Unknown	69.7 Independent support · 76/76 reference peers	78.0 Independent support · 61/61 reference peers	Unknown	Unknown	Unknown	Unknown	54.5 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	44.4 Provider reports · 9/9 reference peers	72.7 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown
Muse Spark 1.1	57.8 Independent support · 8/8 reference peers	50.0 Provider reports · 3/3 reference peers	Unknown	66.7 Provider reports · 3/3 reference peers	100.0 Provider reports · 3/3 reference peers	Unknown	66.7 Provider reports · 3/3 reference peers	33.3 Provider reports · 3/3 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 3/3 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	83.3 Independent support · 5/5 reference peers	Unknown	30.6 Independent support · 27/27 reference peers	Unknown	Unknown	Unknown	96.1 Independent support · 76/76 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	66.7 Provider reports · 3/3 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	50.0 Provider reports · 2/2 reference peers	Unknown	Unknown	Unknown	Unknown
Amazon Nova 2 Lite	Unknown	Unknown	Unknown	Unknown	50.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	63.6 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	36.4 Provider reports · 11/11 reference peers	Unknown	63.6 Provider reports · 11/11 reference peers	Unknown	Unknown	23.6 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	33.3 Provider reports · 9/9 reference peers	Unknown	Unknown	14.5 Independent support · 76/76 reference peers	36.4 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	36.4 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	66.7 Provider reports · 9/9 reference peers	36.4 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown
Claude Opus 4.7	100.0 Provider reports · 5/5 reference peers	Unknown	35.7 Provider reports · 7/7 reference peers	Unknown	100.0 Provider reports · 7/7 reference peers	Unknown	Unknown	85.7 Provider reports · 7/7 reference peers	Unknown	80.0 Provider reports · 5/5 reference peers	33.3 Provider reports · 3/3 reference peers	Unknown	Unknown	75.0 Independent support · 8/8 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 6/6 reference peers	100.0 Provider reports · 6/6 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	98.7 Independent support · 76/76 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	20.0 Provider reports · 5/5 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown
Gemini 2.5 Flash	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	Unknown	36.4 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	63.6 Provider reports · 11/11 reference peers	13.6 Independent support · 59/59 reference peers	27.3 Provider reports · 11/11 reference peers	Unknown	Unknown	8.3 Independent support · 24/24 reference peers	Unknown	Unknown	Unknown	22.2 Provider reports · 9/9 reference peers	Unknown	Unknown	43.4 Independent support · 76/76 reference peers	54.5 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	68.2 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	11.1 Provider reports · 9/9 reference peers	63.6 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown
GPT-5	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	77.3 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	81.8 Provider reports · 11/11 reference peers	33.9 Independent support · 59/59 reference peers	100.0 Provider reports · 11/11 reference peers	Unknown	Unknown	66.7 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	88.9 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	90.9 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	100.0 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	33.3 Provider reports · 9/9 reference peers	54.5 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown
GPT-5 Mini	Unknown	Unknown	Unknown	Unknown	25.0 Provider reports · 4/4 reference peers	Unknown	Unknown	Unknown	45.5 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown	54.5 Provider reports · 11/11 reference peers	22.0 Independent support · 59/59 reference peers	72.7 Provider reports · 11/11 reference peers	Unknown	Unknown	55.6 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	77.8 Provider reports · 9/9 reference peers	Unknown	Unknown	Unknown	63.6 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	81.8 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	0.0 Provider reports · 9/9 reference peers	27.3 Provider reports · 11/11 reference peers	Unknown	Unknown	Unknown	Unknown	Unknown

Family definitions and scoring rules · Compare capabilities · Compare published evidence