RankingDeepSWE v1.1 · v1.1

DeepSWE v1.1 · v1.1

Data updated 24 Sept 2026

Bucket
Coding
Unit
percent
Direction
Higher is better
Version
v1.1
Display harness
GPT-6 Astra: A new generation of intelligence
Board
https://openai.com/index/gpt-6-astra/

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–23 of 23 entries

ModelScoreHarnessEvidenceSource-recorded date
GPT-6 AstraOpenAI74.1%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / GPT‑6 Astra · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Gemini 3.8 FlashGoogle73.8%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Gemini 3.8 Flash · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Opus 5Anthropic73.7%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Opus 5 · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
GPT-5.6 SolOpenAI72.7%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / GPT‑5.6 Sol · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Fable 5Anthropic69.9%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5 · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Fable 5.1Anthropic67.4%
Reported settings & source

Maximum reported across reasoning efforts; OpenAI research environment or API

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5.1 · reviewed 2026-09-06

GPT-6 Astra: A new generation of intelligencelab self-report2026-09-06
Claude Fable 5Anthropic69.7%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Claude Fable 5 · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
Claude Opus 4.8Anthropic59%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Claude Opus 4.8 · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
Gemini 3.1 ProGoogle11.8%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Gemini 3.1 Pro Preview · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.5OpenAI67%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.5 · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.6 LunaOpenAI67.2%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Luna · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.6 SolOpenAI72.7%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Sol · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-5.6 TerraOpenAI69.6%
Reported settings & source

Launch table reported configuration; per-cell reasoning effort unspecified

Provider-published result; comparator measurements are not automatically independently reproduced.

GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Terra · reviewed 2026-09-06

GPT-5.6: Frontier intelligence that scales with your ambitionlab self-report2026-09-06
GPT-6 LunaOpenAI2.43%
Reported settings & source

Reported reasoning effort low. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.0243, stored as 2.43 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / low · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 LunaOpenAI44.47%
Reported settings & source

Reported reasoning effort medium. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.4447, stored as 44.47 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / medium · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 LunaOpenAI59.29%
Reported settings & source

Reported reasoning effort high. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.5929, stored as 59.29 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / high · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 LunaOpenAI61.28%
Reported settings & source

Reported reasoning effort xhigh. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.6128, stored as 61.28 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / xhigh · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 LunaOpenAI66.59%
Reported settings & source

Reported reasoning effort max. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.6659, stored as 66.59 percent. Not an independent board. Article prose rounds this max point to 66.6%.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / max · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 SolOpenAI37.17%
Reported settings & source

Reported reasoning effort low. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.3717, stored as 37.17 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / low · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 SolOpenAI56.64%
Reported settings & source

Reported reasoning effort medium. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.5664, stored as 56.64 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / medium · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 SolOpenAI65.27%
Reported settings & source

Reported reasoning effort high. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.6527, stored as 65.27 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / high · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 SolOpenAI66.59%
Reported settings & source

Reported reasoning effort xhigh. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.6659, stored as 66.59 percent. Not an independent board.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / xhigh · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22
GPT-6 SolOpenAI68.81%
Reported settings & source

Reported reasoning effort max. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page.

Provider-published lab self-report. Vega-Lite chart data value 0.6881, stored as 68.81 percent. Not an independent board. Article prose rounds this max point to 68.8%.

Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison.

Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / max · reviewed 2026-09-22

Introducing GPT-6 Sol and Lunalab self-report2026-09-22