RankingDeepSWE v1.1 · v1.1

DeepSWE v1.1 · v1.1

Data updated 12 Sept 2026

Bucket
Coding
Unit
percent
Direction
Higher is better
Version
v1.1
Display harness
GPT-6 Astra: A new generation of intelligence
Board
https://openai.com/index/gpt-6-astra/

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
GPT-6 AstraOpenAI74.1%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / GPT‑6 Astra · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Gemini 3.8 FlashGoogle73.8%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Gemini 3.8 Flash · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Opus 5Anthropic73.7%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Opus 5 · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
GPT-5.6 SolOpenAI72.7%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / GPT‑5.6 Sol · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Fable 5Anthropic69.9%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5 · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Fable 5.1Anthropic67.4%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5.1 · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Fable 5Anthropic69.7%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Claude Fable 5 · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
Claude Opus 4.8Anthropic59%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Claude Opus 4.8 · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
Gemini 3.1 ProGoogle11.8%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Gemini 3.1 Pro Preview · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.5OpenAI67%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.5 · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.6 LunaOpenAI67.2%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Luna · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.6 SolOpenAI72.7%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Sol · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.6 TerraOpenAI69.6%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Terra · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06