RankingDeepSeek V4-Pro 0813

DeepSeek V4-Pro 0813

Data updated 22 Oct 2026

29 published benchmark measures · 8 benchmark families contribute across 4 task areas. 3 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →

Performance profile

Capabilities

Adjusted comparison score · 0–100

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic3 families · 1 with independent evidence · Supported64.4

3 core families; 46 direct opponents across 17 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 46.4–81.9; 0/13 scenarios unsupported. Without one publisher: 57.2–70.2; 0/15 unsupported. Smoothing check: 61.3–65.7; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

GDPval: 76.2 observed win share
artificialanalysis.ai · Source 1
AutomationBench: 75.0 observed win share
DeepSeek, Z.ai · Source 1 Source 2
Toolathlon: 50.0 observed win share
DeepSeek, Z.ai · Source 1 Source 2

Hard reasoning3 families · 1 with independent evidence · Supported60.4

3 core families; 63 direct opponents across 10 labs.

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: 48.4–60.4; 2/6 scenarios unsupported. Without one publisher: 53.2–67.1; 1/16 unsupported. Smoothing check: 57.6–61.7; 0/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

ARC-AGI: 58.5 observed win share
arcprize.org · Source 1
GPQA: 100.0 observed win share
artificialanalysis.ai · Source 1
Humanity’s Last Exam: 70.8 observed win share
DeepSeek, Z.ai · Source 1 Source 2 Source 3

Coding1 families · 1 with independent evidence · Preliminary62.0

1 core families; 27 direct opponents across 9 labs. Needs broader benchmark and opponent support

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 6/6 scenarios unsupported. Without one publisher: No supported estimate; 19/19 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

DeepSWE: 59.0 observed win share
DeepSeek, Z.ai, deepswe.datacurve.ai · Source 1 Source 2 Source 3

Human pref1 families · 1 with independent evidence · PreliminaryUnknown

1 core families; 76 direct opponents across 17 labs. No connected comparison to the complete reference panel

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Human preference (Arena): 80.3 observed win share
lmarena.ai · Source 1

KnowledgeNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

MultimodalNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 8/8 scenarios unsupported. Without one publisher: No supported estimate; 8/8 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Long contextNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

Reported effort · Max + unspecified

Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

Max: 4 observations
Not specified: 31 observations

Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

Inspect each result and its source ↓ · Download effort evidence

Score contributions and missing evidence

8 contributing families across 4 capabilities. Fixed reference panels do not change when the catalog expands.

Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

Model information & shareable badge

Lab: DeepSeek
Catalog status: api-listed
Availability: Documented provider API and open weights for self-hosting
Family: DeepSeek V4
Released: —
Context: 1,000,000 tokens
License: mit
Model card: https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813
Default Capability family coverage: /badge/deepseek-v4-pro.svg

Benchmark scores & sources

Original results, evaluation harnesses, and evidence behind this model.

Benchmark	Bucket	Score	Harness	Evidence	Source-recorded date
NL2Repo · source release snapshot; version not specified	Supporting evidence	61.5% Reported settings & source DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: NL2Repo · reviewed 2026-10-18	Published configuration Effort: Max	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-10-18
NL2Repo · source release snapshot; version not specified	Supporting evidence	61.1% Reported settings & source GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-10-18	Published configuration Effort: Not specified	lab self-report Supporting evidence outside the reviewed capability core	Reviewed 2026-10-18
SWE-bench Pro	Coding	55.4%	SWE-bench Pro reported Effort: Not specified	lab self-report Legacy self-report lacks a reviewed comparison configuration	2026-08-13
SWE-bench Verified	Coding	80.6%	SWE-bench Verified official Effort: Not specified	lab self-report Legacy self-report lacks a reviewed comparison configuration	2026-08-13
Terminal Bench 2.1 · 2.1	Coding	87.9% Reported settings & source DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: Terminal Bench 2.1 · reviewed 2026-10-18	Published configuration Effort: Max	lab self-report Terminal-Bench coding slot admits version 4.0 only. Earlier versions remain stored and are not mixed into that slot.	Reviewed 2026-10-18
Terminal Bench 2.1 · 2.1	Coding	87.9% Reported settings & source GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: Terminal Bench 2.1 · reviewed 2026-10-18	Published configuration Effort: Not specified	lab self-report Terminal-Bench coding slot admits version 4.0 only. Earlier versions remain stored and are not mixed into that slot.	Reviewed 2026-10-18
Terminal-Bench 2.1	Coding	87.9%	Terminal-Bench 2.1 reported Effort: Not specified	lab self-report Legacy self-report lacks a reviewed comparison configuration	2026-08-13
Toolathlon Verified · source release snapshot; version not specified	Agentic	74.1% Reported settings & source GLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: Toolathlon Verified · reviewed 2026-10-18	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-10-18
Toolathlon-Verified · source release snapshot; version not specified	Agentic	74.1% Reported settings & source DeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: Toolathlon-Verified · reviewed 2026-10-18	Published configuration Effort: Not specified contributes to capability	lab self-report	Reviewed 2026-10-18
Toolathlon-Verified (official board)	Supporting evidence	74.4%	Toolathlon-Verified Default agent Effort: Not specified	official board Supporting evidence outside the reviewed capability core	2026-08-13
MMLU-Pro	Knowledge	—	—	—	—
OSWorld-Verified	Agentic	—	—	—	—