RankingDeepSWE v1.1 · v1.1
DeepSWE v1.1 · v1.1
- Bucket
- Coding
- Unit
- percent
- Direction
- Higher is better
- Version
- v1.1
- Display harness
- GPT-6 Astra: A new generation of intelligence
- Board
- https://openai.com/index/gpt-6-astra/
Compare published benchmark results with category weights →
Models
1–25 of 38 entries
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| GPT-6 AstraOpenAI | 74.1%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / GPT‑6 Astra · reviewed 2026-09-06 | GPT-6 Astra: A new generation of intelligence | lab self-report | 2026-09-06 |
| Gemini 3.8 FlashGoogle | 73.8%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Gemini 3.8 Flash · reviewed 2026-09-06 | GPT-6 Astra: A new generation of intelligence | lab self-report | 2026-09-06 |
| Claude Opus 5Anthropic | 73.7%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Opus 5 · reviewed 2026-09-06 | GPT-6 Astra: A new generation of intelligence | lab self-report | 2026-09-06 |
| GPT-5.6 SolOpenAI | 72.7%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / GPT‑5.6 Sol · reviewed 2026-09-06 | GPT-6 Astra: A new generation of intelligence | lab self-report | 2026-09-06 |
| Claude Fable 5Anthropic | 69.9%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5 · reviewed 2026-09-06 | GPT-6 Astra: A new generation of intelligence | lab self-report | 2026-09-06 |
| Claude Fable 5.1Anthropic | 67.4%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Coding table / DeepSWE v1.1 / Claude Fable 5.1 · reviewed 2026-09-06 | GPT-6 Astra: A new generation of intelligence | lab self-report | 2026-09-06 |
| Claude Fable 5Anthropic | 69.7%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Claude Fable 5 · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| Claude Opus 4.8Anthropic | 59%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Claude Opus 4.8 · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| Gemini 3.1 ProGoogle | 11.8%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / Gemini 3.1 Pro Preview · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| GPT-5.5OpenAI | 67%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.5 · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| GPT-5.6 LunaOpenAI | 67.2%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Luna · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| GPT-5.6 SolOpenAI | 72.7%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Sol · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| GPT-5.6 TerraOpenAI | 69.6%Reported settings & sourceLaunch table reported configuration; per-cell reasoning effort unspecified Provider-published result; comparator measurements are not automatically independently reproduced. GPT-5.6: Frontier intelligence that scales with your ambition · Coding table / DeepSWE v1.1 / GPT‑5.6 Terra · reviewed 2026-09-06 | GPT-5.6: Frontier intelligence that scales with your ambition | lab self-report | 2026-09-06 |
| GPT-6 AstraOpenAI | 67.04%Reported settings & sourceReported reasoning effort low. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.5952; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Astra / low · reviewed 2026-09-29 | Introducing GPT-6.1 Sol | lab self-report | 2026-09-29 |
| GPT-6 AstraOpenAI | 72.79%Reported settings & sourceReported reasoning effort medium. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $3.0755; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Astra / medium · reviewed 2026-09-29 | Introducing GPT-6.1 Sol | lab self-report | 2026-09-29 |
| GPT-6 AstraOpenAI | 73.23%Reported settings & sourceReported reasoning effort high. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $3.9237; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Astra / high · reviewed 2026-09-29 | Introducing GPT-6.1 Sol | lab self-report | 2026-09-29 |
| GPT-6 AstraOpenAI | 74.12%Reported settings & sourceReported reasoning effort xhigh. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $4.4291; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Astra / xhigh · reviewed 2026-09-29 | Introducing GPT-6.1 Sol | lab self-report | 2026-09-29 |
| GPT-6 AstraOpenAI | 73.23%Reported settings & sourceReported reasoning effort max. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $7.4978; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Astra / max · reviewed 2026-09-29 | Introducing GPT-6.1 Sol | lab self-report | 2026-09-29 |
| GPT-6 LunaOpenAI | 2.43%Reported settings & sourceReported reasoning effort low. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.0243, stored as 2.43 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / low · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |
| GPT-6 LunaOpenAI | 44.47%Reported settings & sourceReported reasoning effort medium. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.4447, stored as 44.47 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / medium · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |
| GPT-6 LunaOpenAI | 59.29%Reported settings & sourceReported reasoning effort high. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.5929, stored as 59.29 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / high · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |
| GPT-6 LunaOpenAI | 61.28%Reported settings & sourceReported reasoning effort xhigh. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.6128, stored as 61.28 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / xhigh · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |
| GPT-6 LunaOpenAI | 66.59%Reported settings & sourceReported reasoning effort max. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.6659, stored as 66.59 percent. Not an independent board. Article prose rounds this max point to 66.6%. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Luna / max · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |
| GPT-6 SolOpenAI | 37.17%Reported settings & sourceReported reasoning effort low. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.3717, stored as 37.17 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / low · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |
| GPT-6 SolOpenAI | 56.64%Reported settings & sourceReported reasoning effort medium. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.5664, stored as 56.64 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / medium · reviewed 2026-09-22 | Introducing GPT-6 Sol and Luna | lab self-report | 2026-09-22 |