RankingGPT-6.1 Sol

GPT-6.1 Sol

Data updated 30 Sept 2026

11 published benchmark measures · 5 benchmark families contribute across 2 task areas. 2 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →

Model evidence summary

This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →

Performance profile

Capabilities

Adjusted comparison score · 0–100

Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.

Agentic4 families · 0 with independent evidence · Preliminary93.6

4 core families; 2 direct opponents across 1 labs. Needs broader benchmark and opponent support

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 13/13 scenarios unsupported. Without one publisher: No supported estimate; 15/15 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage; source sensitivity still requires inspection. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

AutomationBench: 50.0 observed win share
OpenAI · Source 1 Source 2 Source 3 Source 4 Source 5
OSWorld: 50.0 observed win share
OpenAI · Source 1 Source 2 Source 3 Source 4 Source 5
Terminal-Bench Science: 50.0 observed win share
OpenAI · Source 1 Source 2 Source 3 Source 4 Source 5
GDP.pdf: 65.0 observed win share
OpenAI · Source 1 Source 2 Source 3 Source 4 Source 5

Hard reasoningNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 6/6 scenarios unsupported. Without one publisher: No supported estimate; 16/16 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Coding1 families · 0 with independent evidence · Preliminary96.9

1 core families; 2 direct opponents across 1 labs. Needs broader benchmark and opponent support

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 6/6 scenarios unsupported. Without one publisher: No supported estimate; 19/19 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts improved on neutral predictions within evaluated coverage. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

DeepSWE: 70.0 observed win share
OpenAI · Source 1 Source 2 Source 3 Source 4 Source 5

Human prefNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 1/1 scenarios unsupported. Without one publisher: No supported estimate; 1/1 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: cross-family and cross-publisher predictions could not be evaluated from the available comparison network. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

KnowledgeNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 4/4 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: almost no publisher-held-out comparisons remained estimable. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

MultimodalNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 8/8 scenarios unsupported. Without one publisher: No supported estimate; 8/8 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: limited publisher-held-out coverage. Cross-source validity is unresolved. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Long contextNo comparable evidenceUnknown

0 core families; 0 direct opponents across 0 labs. No admitted core comparisons

Estimated against the same complete panel: gpt-5.6-sol claude-opus-4-8 gemini-3.1-pro . Indirect comparisons assume performance can be summarized by one strength within this capability.

Refit without one family: No supported estimate; 5/5 scenarios unsupported. Without one publisher: No supported estimate; 5/5 unsupported. Smoothing check: No supported estimate; 3/3 unsupported. These are sensitivity checks, not confidence intervals.

Audit: family and publisher holdouts underperformed neutral predictions. Treat this as an exploratory estimate. Validation audit.

Matched family win shares below describe source evidence; they are not averaged to produce the adjusted score.

Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.

Reported effort · Mixed settings

Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.

High: 6 observations
Low: 6 observations
Max: 9 observations
Medium: 6 observations
XHigh: 7 observations
Not specified: 1 observations

Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.

Inspect each result and its source ↓ · Download effort evidence

Score contributions and missing evidence

5 contributing families across 2 capabilities. Fixed reference panels do not change when the catalog expands.

Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.

Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.

Model information & shareable badge

Lab: OpenAI
Catalog status: active
Availability: Public provider catalog; account and region restrictions may apply
Family: GPT-6.1
Released: 2026-09-29
Context: 1,050,000 tokens
API list price: $2 input / $10 output per million tokens
Standard rate for requests up to 272,000 input tokens. Longer requests are priced at 2× input and 1.5× output for the whole request.
License: proprietary
Model card: https://developers.openai.com/api/docs/models/gpt-6.1-sol
Default Capability family coverage: /badge/gpt-6.1-sol.svg

Benchmark scores & sources

Original results, evaluation harnesses, and evidence behind this model.

Benchmark	Bucket	Score	Harness	Evidence	Source-recorded date
OSWorld 2.0 (v2026.08.08, offline set, partial score) · 2.0 / v2026.08.08 offline	Agentic	69.56% Reported settings & source Reported reasoning effort high. Offline set from v2026.08.08; partial reward, not binary full-task success or OSWorld Verified. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $0.9613; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: OSWorld 2.0, offline set / GPT-6.1 Sol / high · reviewed 2026-09-29	Published configuration Effort: High contributes to capability	lab self-report	Reviewed 2026-09-29
OSWorld 2.0 (v2026.08.08, offline set, partial score) · 2.0 / v2026.08.08 offline	Agentic	69.38% Reported settings & source Reported reasoning effort xhigh. Offline set from v2026.08.08; partial reward, not binary full-task success or OSWorld Verified. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.0466; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: OSWorld 2.0, offline set / GPT-6.1 Sol / xhigh · reviewed 2026-09-29	Published configuration Effort: XHigh contributes to capability	lab self-report	Reviewed 2026-09-29
OSWorld 2.0 (v2026.08.08, offline set, partial score) · 2.0 / v2026.08.08 offline	Agentic	71.42% Reported settings & source Reported reasoning effort max. Offline set from v2026.08.08; partial reward, not binary full-task success or OSWorld Verified. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.2689; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: OSWorld 2.0, offline set / GPT-6.1 Sol / max · reviewed 2026-09-29	Published configuration Effort: Max contributes to capability	lab self-report	Reviewed 2026-09-29
Reviewer bypass attempts · Sol 6.1 launch / safety stress test	Supporting evidence	0% Reported settings & source Reported reasoning effort max. Attempts to work around an automated safety reviewer blocking an action. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Safety stress outcomes are retained for inspection and excluded from capability scoring. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Safety failure behavior is not a capability or intelligence score. Introducing GPT-6.1 Sol · Chart: Reviewer bypass attempts (lower is better) / GPT-6.1 Sol / max · reviewed 2026-09-29	Published configuration Effort: Max	lab self-report Safety failure behavior is not a capability or intelligence score.	Reviewed 2026-09-29
Terminal-Bench Science 0.1 · 0.1	Agentic	43.71% Reported settings & source Reported reasoning effort low. Scientific research workflows using code and terminal tools, including analysis, simulation and model fitting. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.7918; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: Terminal-Bench Science 0.1 / GPT-6.1 Sol / low · reviewed 2026-09-29	Published configuration Effort: Low contributes to capability	lab self-report	Reviewed 2026-09-29
Terminal-Bench Science 0.1 · 0.1	Agentic	47.56% Reported settings & source Reported reasoning effort medium. Scientific research workflows using code and terminal tools, including analysis, simulation and model fitting. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $2.3386; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: Terminal-Bench Science 0.1 / GPT-6.1 Sol / medium · reviewed 2026-09-29	Published configuration Effort: Medium contributes to capability	lab self-report	Reviewed 2026-09-29
Terminal-Bench Science 0.1 · 0.1	Agentic	51.14% Reported settings & source Reported reasoning effort high. Scientific research workflows using code and terminal tools, including analysis, simulation and model fitting. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $2.7594; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: Terminal-Bench Science 0.1 / GPT-6.1 Sol / high · reviewed 2026-09-29	Published configuration Effort: High contributes to capability	lab self-report	Reviewed 2026-09-29
Terminal-Bench Science 0.1 · 0.1	Agentic	53.71% Reported settings & source Reported reasoning effort xhigh. Scientific research workflows using code and terminal tools, including analysis, simulation and model fitting. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $2.8922; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: Terminal-Bench Science 0.1 / GPT-6.1 Sol / xhigh · reviewed 2026-09-29	Published configuration Effort: XHigh contributes to capability	lab self-report	Reviewed 2026-09-29
Terminal-Bench Science 0.1 · 0.1	Agentic	57.02% Reported settings & source Reported reasoning effort max. Scientific research workflows using code and terminal tools, including analysis, simulation and model fitting. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $5.4652; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: Terminal-Bench Science 0.1 / GPT-6.1 Sol / max · reviewed 2026-09-29	Published configuration Effort: Max contributes to capability	lab self-report	Reviewed 2026-09-29
Warning circumvention · Sol 6.1 launch / safety stress test	Supporting evidence	23.48% Reported settings & source Reported reasoning effort max. Restriction-circumvention attempts in deliberately difficult low-stakes cases without full product safeguards. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Safety stress outcomes are retained for inspection and excluded from capability scoring. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Safety failure behavior is not a capability or intelligence score. Introducing GPT-6.1 Sol · Chart: Warning circumvention (lower is better) / GPT-6.1 Sol / max · reviewed 2026-09-29	Published configuration Effort: Max	lab self-report Safety failure behavior is not a capability or intelligence score.	Reviewed 2026-09-29
ARC-AGI-2	Hard reasoning	—	—	—	—
DeepSWE v1.1	Agentic	—	—	—	—
GDPval-AA	Agentic	—	—	—	—
GPQA Diamond	Hard reasoning	—	—	—	—
Humanity's Last Exam	Hard reasoning	—	—	—	—
LiveCodeBench	Coding	—	—	—	—
LMArena Text Arena	Human pref	—	—	—	—
MMLU-Pro	Knowledge	—	—	—	—
OSWorld-Verified	Agentic	—	—	—	—
SWE-bench Pro	Agentic	—	—	—	—
SWE-bench Verified	Agentic	—	—	—	—
Terminal-Bench 2.1	Agentic	—	—	—	—