RankingGemini 3.8 Flash

Gemini 3.8 Flash

Data updated 22 Oct 2026

33 published benchmark measures · 9 benchmark families contribute across 4 task areas. 4 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →

Performance profile

Capabilities

Adjusted comparison score · 0–100

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic2 families · 0 with independent evidence · Supported55.0

2 core families; 5 direct opponents across 3 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 51.4–59.2; 2/13 scenarios unsupported. Without one publisher: 45.0–58.9; 1/15 unsupported. Smoothing check: 54.2–55.0; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

GDPval: 40.0 observed win share
Google · Source 1
GDP.pdf: 60.0 observed win share
Google · Source 1

Hard reasoning3 families · 3 with independent evidence · Supported87.1

3 core families; 65 direct opponents across 11 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 81.2–91.6; 0/6 scenarios unsupported. Without one publisher: 77.7–90.8; 0/16 unsupported. Smoothing check: 78.0–91.2; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

GPQA: 85.0 observed win share
OpenAI, artificialanalysis.ai · Source 1 Source 2
ARC-AGI: 85.6 observed win share
arcprize.org · Source 1
Humanity’s Last Exam: 93.8 observed win share
Google, scale.com · Source 1 Source 2

Coding2 families · 2 with independent evidence · Supported58.3

2 core families; 35 direct opponents across 9 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 58.3–67.0; 2/6 scenarios unsupported. Without one publisher: 53.7–64.3; 0/19 unsupported. Smoothing check: 57.3–58.3; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Terminal-Bench: 22.9 observed win share
Google, OpenAI, tbench.ai · Source 1 Source 2 Source 3
DeepSWE: 92.1 observed win share
Google, OpenAI, deepswe.datacurve.ai · Source 1 Source 2 Source 3

Human prefNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

KnowledgeNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Multimodal2 families · 0 with independent evidence · Supported93.3

2 core families; 5 direct opponents across 3 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 92.7–94.5; 2/8 scenarios unsupported. Without one publisher: 76.9–95.4; 1/8 unsupported. Smoothing check: 84.8–96.9; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

CharXiv: 100.0 observed win share
Google · Source 1
Lvbench: 100.0 observed win share
Google · Source 1

Long contextNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

Reported effort · High thinking + unspecified

Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

High thinking: 1 observations
Not specified: 36 observations

Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

Inspect each result and its source ↓ · Download effort evidence

Score contributions and missing evidence

9 contributing families across 4 capabilities. Fixed reference panels do not change when the catalog expands.

Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

Model information & shareable badge

Lab: Google
Catalog status: active
Availability: Public provider catalog; account and region restrictions may apply
Family: Gemini 3
Released: —
Context: —
License: proprietary
Model card: https://ai.google.dev/gemini-api/docs/models
Default Capability family coverage: /badge/gemini-3.8-flash.svg

Benchmark scores & sources

Original results, evaluation harnesses, and evidence behind this model.

Benchmark	Bucket	Score	Harness	Evidence	Source-recorded date
ARC-AGI-2	Hard reasoning	89.2%	ARC Prize verified Effort: Not specified contributes to capability	official board	2026-09-02
Artificial Analysis Coding Agent Index v1.4 · v1.4	Supporting evidence	61.2 index score Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / Artificial Analysis Coding Agent Index v1.4 / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Composite index or publisher-specific internal evaluation lacks a stable general-capability comparison unit.	Reviewed 2026-09-06
Artificial Analysis Cyber Index	Supporting evidence	25.1449496510851	Artificial Analysis Stirrup · Cyber Index v1.0 · high Effort: High Cyber Index source settings Artificial Analysis Stirrup, v1.0. Display only. This composite measures defensive source-code tasks. Successful capability scores depend on safety refusals, and refusal rates are reported separately. It does not enter weighted Overall. Official Cyber Index board	official board Supporting evidence outside the reviewed capability core	2026-10-21
Artificial Analysis Intelligence Index v4.1.1 · v4.1.1	Supporting evidence	58.7 index score Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Professional table / Artificial Analysis Intelligence Index v4.1.1 / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Composite index or publisher-specific internal evaluation lacks a stable general-capability comparison unit.	Reviewed 2026-09-06
AutoResearchExam	Supporting evidence	0.484	AutoResearchExam Terminus 2 Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-09-09
BioMysteryBench · Human Difficult	Supporting evidence	56.5% Reported settings & source Linuxterminal,bioinfotools,Python,R; allowlistednetwork; Gemini/GPTselfcomputed,Claudeproviderreports Gemini3.8Flash Model Card · Model card page5 Results table · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Narrow specialist biological, medical or security evaluation; preserved as raw evidence outside general capability scoring.	Reviewed 2026-09-06
BioMysteryBench · Human Solvable	Supporting evidence	88.8% Reported settings & source Linuxterminal,bioinfotools,Python,R; allowlistednetwork; Gemini/GPTselfcomputed,Claudeproviderreports Gemini3.8Flash Model Card · Model card page5 Results table · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Narrow specialist biological, medical or security evaluation; preserved as raw evidence outside general capability scoring.	Reviewed 2026-09-06
Bug Hunt Bench	Supporting evidence	17.14%	Bug Hunt Bench · high Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-09-15
CharXiv Reasoning	Multimodal	86.2% Reported settings & source No tools; Gemini/GPT/Opus selfcomputed; Sonnet selfreported Gemini3.8Flash Model Card · Model card page5 Results table · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
DAYJOB Finance	Supporting evidence	2.8%	DAYJOB Finance · high Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-10-21
DAYJOB Healthcare	Supporting evidence	0.8%	DAYJOB Healthcare · high Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-10-21
DeepSWE · 1.1	Coding	73.7% Reported settings & source Datacurve highest reported effort; Gemini3.8selfcomputed mini-swe-agent highthinking Card Opus74 explicitly corrected as erroneous in linkedmethodology; omitted. Gemini3.8Flash Model Card · Model card page5 Results table · reviewed 2026-09-06	Published configuration Effort: High thinking contributes to capability	lab self-report	Reviewed 2026-09-06
DeepSWE v1.1	Coding	73.8%	DeepSWE v1.1 reported Effort: Not specified contributes to capability	official board	2026-09-22
DeepSWE v1.1 · v1.1	Coding	73.8% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
Finance Agent v2 · source release snapshot; version not specified	Supporting evidence	61.4% Reported settings & source Google launch chart; benchmark methodology linked on page; reported comparator settings vary. First-party reported result; comparator results retain the source evaluation setup. Gemini 3.8 Flash launch performance · Performance table · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-09-06
FrontierCode 1.1 Extended (score) · 1.1	Supporting evidence	56.3% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / FrontierCode 1.1 Extended (score) / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-09-06
FrontierCode 1.1 Main (score) · 1.1	Supporting evidence	43.6% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / FrontierCode 1.1 Main (score) / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-09-06
FrontierSWE v2	Supporting evidence	19.6%	Proximal FrontierSWE v2 · Proximus · unspecified Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-10-22
GDP.PDF	Agentic	35% Reported settings & source All-pass rate; allmodels selfcomputed byGoogle Gemini3.8Flash Model Card · Model card page5 Results table · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
GDPval-AA · 2	Agentic	1545 Reported settings & source Artificial Analysis publicboard snapshot; effort as reported Gemini3.8Flash Model Card · Model card page5 Results table · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
GPQA Diamond	Hard reasoning	95.253%	GPQA Diamond reported Effort: Not specified contributes to capability	independent repro	2026-10-20
GPQA Diamond · not specified	Hard reasoning	95.3% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Academic table / GPQA Diamond / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06
Harvey Legal Agent Benchmark · source release snapshot; version not specified	Supporting evidence	10% Reported settings & source Google launch chart; benchmark methodology linked on page; reported comparator settings vary. First-party reported result; comparator results retain the source evaluation setup. Gemini 3.8 Flash launch performance · Performance table · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-09-06
HealthBench Professional (length-adjusted) · not specified	Supporting evidence	52.1% Reported settings & source Maximum reported across reasoning efforts; OpenAI research environment or API; official paper scoring; length-adjusted Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Science And Health table / HealthBench Professional (length-adjusted) / Gemini 3.8 Flash · reviewed 2026-09-06	Published configuration Effort: Not specified	lab self-report Narrow specialist biological, medical or security evaluation; preserved as raw evidence outside general capability scoring.	Reviewed 2026-09-06
HLE-Verified · source release snapshot; version not specified	Hard reasoning	54.9% Reported settings & source Google launch chart; benchmark methodology linked on page; reported comparator settings vary. First-party reported result; comparator results retain the source evaluation setup. Gemini 3.8 Flash launch performance · Performance table · reviewed 2026-09-06	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-09-06