RankingGPT-6 Sol
GPT-6 Sol
24 published benchmark measures · 7 benchmark families contribute across 3 task areas. 3 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →
Model evidence summary
This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →
Performance profile
Capabilities
Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.
Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.
Reported effort · Mixed settings
Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.
- High: 11 observations
- Low: 11 observations
- Max: 14 observations
- Medium: 11 observations
- XHigh: 12 observations
- Not specified: 15 observations
Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.
Inspect each result and its source ↓ · Download effort evidenceScore contributions and missing evidence
7 contributing families across 3 capabilities. Fixed reference panels do not change when the catalog expands.
Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.
Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.
Model information & shareable badge
- Lab
- OpenAI
- Catalog status
- active
- Availability
- Public provider catalog; account and region restrictions may apply
- Family
- GPT-6
- Released
- 2026-09-22
- Context
- 1,050,000 tokens
- API list price
- $2 input / $10 output per million tokens
- License
- proprietary
- Model card
- https://developers.openai.com/api/docs/models/gpt-6-sol
- Default Capability family coverage
/badge/gpt-6-sol.svg
Benchmark scores & sources
Original results, evaluation harnesses, and evidence behind this model.
| Benchmark | Bucket | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|---|
| DeepSWE v1.1 · v1.1 | Coding | 37.17%Reported settings & sourceReported reasoning effort low. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.3717, stored as 37.17 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / low · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| DeepSWE v1.1 · v1.1 | Coding | 56.64%Reported settings & sourceReported reasoning effort medium. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.5664, stored as 56.64 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / medium · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| DeepSWE v1.1 · v1.1 | Coding | 65.27%Reported settings & sourceReported reasoning effort high. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.6527, stored as 65.27 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / high · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| DeepSWE v1.1 · v1.1 | Coding | 66.59%Reported settings & sourceReported reasoning effort xhigh. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.6659, stored as 66.59 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / xhigh · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| DeepSWE v1.1 · v1.1 | Coding | 68.81%Reported settings & sourceReported reasoning effort max. DeepSWE v1.1. Original long-horizon software-engineering tasks. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.6881, stored as 68.81 percent. Not an independent board. Article prose rounds this max point to 68.8%. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: DeepSWE / GPT-6 Sol / max · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| DeepSWE v1.1 · v1.1 | Coding | 37.17%Reported settings & sourceReported reasoning effort low. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.1623; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Sol / low · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| DeepSWE v1.1 · v1.1 | Coding | 56.64%Reported settings & sourceReported reasoning effort medium. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.3798; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Sol / medium · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| DeepSWE v1.1 · v1.1 | Coding | 65.27%Reported settings & sourceReported reasoning effort high. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.6404; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Sol / high · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| DeepSWE v1.1 · v1.1 | Coding | 66.59%Reported settings & sourceReported reasoning effort xhigh. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.0033; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Sol / xhigh · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| DeepSWE v1.1 · v1.1 | Coding | 68.81%Reported settings & sourceReported reasoning effort max. Complex software-engineering tasks in original real codebases. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $2.7439; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: DeepSWE / GPT-6 Sol / max · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| Factual error rate on difficult prompts · Sol 6.1 launch / user-flagged conversations | Supporting evidence | 11.42%Reported settings & sourceReported reasoning effort low. Share of answers with at least one factual error on de-identified conversations where users flagged an earlier model error; deliberately difficult, not representative of typical usage. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.0495; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Private user-flagged prompt protocol needs separate review before capability scoring; retained as an exact lower-is-better sourced claim. Introducing GPT-6.1 Sol · Chart: Factual error rate on difficult prompts (lower is better) / GPT-6 Sol / low · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| Factual error rate on difficult prompts · Sol 6.1 launch / user-flagged conversations | Supporting evidence | 6.86%Reported settings & sourceReported reasoning effort medium. Share of answers with at least one factual error on de-identified conversations where users flagged an earlier model error; deliberately difficult, not representative of typical usage. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.0694; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Private user-flagged prompt protocol needs separate review before capability scoring; retained as an exact lower-is-better sourced claim. Introducing GPT-6.1 Sol · Chart: Factual error rate on difficult prompts (lower is better) / GPT-6 Sol / medium · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| Factual error rate on difficult prompts · Sol 6.1 launch / user-flagged conversations | Supporting evidence | 5.14%Reported settings & sourceReported reasoning effort high. Share of answers with at least one factual error on de-identified conversations where users flagged an earlier model error; deliberately difficult, not representative of typical usage. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.0994; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Private user-flagged prompt protocol needs separate review before capability scoring; retained as an exact lower-is-better sourced claim. Introducing GPT-6.1 Sol · Chart: Factual error rate on difficult prompts (lower is better) / GPT-6 Sol / high · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| Factual error rate on difficult prompts · Sol 6.1 launch / user-flagged conversations | Supporting evidence | 4.52%Reported settings & sourceReported reasoning effort xhigh. Share of answers with at least one factual error on de-identified conversations where users flagged an earlier model error; deliberately difficult, not representative of typical usage. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.1348; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Private user-flagged prompt protocol needs separate review before capability scoring; retained as an exact lower-is-better sourced claim. Introducing GPT-6.1 Sol · Chart: Factual error rate on difficult prompts (lower is better) / GPT-6 Sol / xhigh · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| Factual error rate on difficult prompts · Sol 6.1 launch / user-flagged conversations | Supporting evidence | 4.57%Reported settings & sourceReported reasoning effort max. Share of answers with at least one factual error on de-identified conversations where users flagged an earlier model error; deliberately difficult, not representative of typical usage. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.179; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Private user-flagged prompt protocol needs separate review before capability scoring; retained as an exact lower-is-better sourced claim. Introducing GPT-6.1 Sol · Chart: Factual error rate on difficult prompts (lower is better) / GPT-6 Sol / max · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| Failure to disclose a broken search tool · Sol 6.1 launch / safety stress test | Supporting evidence | 4.92%Reported settings & sourceReported reasoning effort max. Adversarial test of whether agents disclose a broken search tool. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Safety stress outcomes are retained for inspection and excluded from capability scoring. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Safety failure behavior is not a capability or intelligence score. Introducing GPT-6.1 Sol · Chart: Failure to disclose a broken search tool (lower is better) / GPT-6 Sol / max · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| FrontierCode 1.1 Main (score) · 1.1 Main | Supporting evidence | 37.28%Reported settings & sourceReported reasoning effort low. FrontierCode 1.1 Main, as identified in the surrounding article. The chart title is FrontierCode. Graded on correctness and mergeability. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.3728, stored as 37.28 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: FrontierCode / GPT-6 Sol / low · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| FrontierCode 1.1 Main (score) · 1.1 Main | Supporting evidence | 45.92%Reported settings & sourceReported reasoning effort medium. FrontierCode 1.1 Main, as identified in the surrounding article. The chart title is FrontierCode. Graded on correctness and mergeability. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.4592, stored as 45.92 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: FrontierCode / GPT-6 Sol / medium · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| FrontierCode 1.1 Main (score) · 1.1 Main | Supporting evidence | 47.7%Reported settings & sourceReported reasoning effort high. FrontierCode 1.1 Main, as identified in the surrounding article. The chart title is FrontierCode. Graded on correctness and mergeability. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.477, stored as 47.7 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: FrontierCode / GPT-6 Sol / high · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| FrontierCode 1.1 Main (score) · 1.1 Main | Supporting evidence | 48.45%Reported settings & sourceReported reasoning effort xhigh. FrontierCode 1.1 Main, as identified in the surrounding article. The chart title is FrontierCode. Graded on correctness and mergeability. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.4845, stored as 48.45 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: FrontierCode / GPT-6 Sol / xhigh · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| FrontierCode 1.1 Main (score) · 1.1 Main | Supporting evidence | 49.27%Reported settings & sourceReported reasoning effort max. FrontierCode 1.1 Main, as identified in the surrounding article. The chart title is FrontierCode. Graded on correctness and mergeability. OpenAI-published chart on the Introducing GPT-6 Sol and Luna page. Provider-published lab self-report. Vega-Lite chart data value 0.4927, stored as 49.27 percent. Not an independent board. Comparison limit: Provider-published lab self-report. Shown as a labeled claim and not admitted as a matched board comparison. Introducing GPT-6 Sol and Luna · Chart: FrontierCode / GPT-6 Sol / max · reviewed 2026-09-22 | Published configuration | lab self-report | Reviewed 2026-09-22 |
| FrontierMath Erdős | Supporting evidence | 1% | FrontierMath Erdős proof scorer | official board | 2026-09-30 |
| gdp.pdf · not specified | Agentic | 21.8%Reported settings & sourceReported reasoning effort low. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.33; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Sol / low · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| gdp.pdf · not specified | Agentic | 25.4%Reported settings & sourceReported reasoning effort medium. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.34; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Sol / medium · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| gdp.pdf · not specified | Agentic | 28%Reported settings & sourceReported reasoning effort high. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.35; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Sol / high · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |