RankingGPQA Diamond

GPQA Diamond

Data updated 22 Oct 2026

Bucket
Hard reasoning
Unit
percent
Direction
Higher is better
Version
diamond
Display harness
GPQA Diamond reported
Board
https://github.com/idavidrein/gpqa

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

26–50 of 471 entries

ModelScoreEvidenceSource-recorded date
Llama 4 MaverickMeta69.8%lab self-report

Diamond score is reported, but matching the current reference prompt, sampling/tool protocol and exact observation is not established.

2025-04-05
Mistral Large 3Mistral68.43%independent repro2026-09-04
Agnes 2.5 Pro AlphaAgnes AI———
Agnes-3.0-Flash PreviewAgnes AI———
Amazon Nova 2 LiteAmazon———
Amazon Nova 2 Pro PreviewAmazon———
Amazon Nova LiteAmazon———
Amazon Nova MicroAmazon———
Amazon Nova PremierAmazon———
Amazon Nova ProAmazon———
AutoGLM-Phone-9BZ.ai———
AutoGLM-Phone-9B-MultilingualZ.ai———
aya-101Cohere———
aya-23-35BCohere———
aya-23-8BCohere———
aya-expanse-8bCohere———
aya-vision-8bCohere———
C4Ai Aya Expanse 32BCohere———
C4Ai Aya Vision 32BCohere———
c4ai-command-r7b-arabic-02-2025Cohere———
chatglm-6bZ.ai———
chatglm2-6bZ.ai———
chatglm2-6b-32kZ.ai———
chatglm3-6bZ.ai———
chatglm3-6b-128kZ.ai———