RankingGPT-6 Astra
GPT-6 Astra
85 published benchmark measures · 13 benchmark families contribute across 5 task areas. 5 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →
Model evidence summary
This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →
Performance profile
Capabilities
Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.
Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.
Reported effort · Mixed settings
Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.
- Best across efforts: 34 observations
- High: 6 observations
- Low: 6 observations
- Max: 10 observations
- Medium: 6 observations
- XHigh: 7 observations
- Not specified: 62 observations
Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.
Inspect each result and its source ↓ · Download effort evidenceScore contributions and missing evidence
13 contributing families across 5 capabilities. Fixed reference panels do not change when the catalog expands.
Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.
Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.
Model information & shareable badge
- Lab
- OpenAI
- Catalog status
- active
- Availability
- Public provider catalog; account and region restrictions may apply
- Family
- GPT-6
- Released
- —
- Context
- 1,050,000 tokens
- License
- proprietary
- Model card
- https://developers.openai.com/api/docs/models/all
- Default Capability family coverage
/badge/gpt-6-astra.svg
Benchmark scores & sources
Original results, evaluation harnesses, and evidence behind this model.
| Benchmark | Bucket | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|---|
| FrontierSWE · 2 | Supporting evidence | 65.5%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Results sourced from Proximal's official public leaderboard. Provider-published launch claim, not independent measurement by Google for every row. Results sourced from Proximal's official public leaderboard. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Historical provider claim; secondary and superseded for current FrontierSWE comparisons by the independent Proximal FrontierSWE v2 mean@5 board at https://www.frontierswe.com/. Version-unspecified claims are not v2 results. Excluded from weighted Overall. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 6: FrontierSWE 2 / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| FrontierSWE v2 | Supporting evidence | 65.5% | Proximal FrontierSWE v2 · Proximus · unspecified | official board | 2026-10-22 |
| gdp.pdf · not specified | Agentic | 30.4%Reported settings & sourceReported reasoning effort low. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.6963186; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Astra / low · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| gdp.pdf · not specified | Agentic | 30.4%Reported settings & sourceReported reasoning effort medium. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.7198086; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Astra / medium · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| gdp.pdf · not specified | Agentic | 31%Reported settings & sourceReported reasoning effort high. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.7948240999999998; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Astra / high · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| gdp.pdf · not specified | Agentic | 32.2%Reported settings & sourceReported reasoning effort xhigh. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $1.9127230999999998; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Astra / xhigh · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| gdp.pdf · not specified | Agentic | 31%Reported settings & sourceReported reasoning effort max. Professional questions about complex PDFs across ten professional domains. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Published chart cost per task $2.0758207; source-specific cost does not establish consensus workload efficiency. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Introducing GPT-6.1 Sol · Chart: GDP.pdf / GPT-6 Astra / max · reviewed 2026-09-29 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-29 |
| GDPval-AA · 2 | Agentic | 1542Reported settings & sourceGrok 4.7 XHigh; Grok 4.6 High; Claude Fable 5.1 Max; GPT-6 Astra Max. GDPval launch chart. Launch chart rounded Elo. Original evaluator: https://artificialanalysis.ai/evaluations/gdpval-aa Comparison limit: Secondary Artificial Analysis leaderboard report; retain the original evaluator once, without treating the launch reprint as additional evidence. Grok 4.7 launch comparison · Professional knowledge work: GDPval chart · reviewed 2026-09-21 | Published configuration | lab self-report | Reviewed 2026-09-21 |
| GeneBench Pro · v13 | Supporting evidence | 37.1%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Science And Health table / GeneBench Pro / GPT‑6 Astra · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| GPQA Diamond | Hard reasoning | 96.061% | GPQA Diamond reportedcontributes to capability | independent repro | 2026-10-20 |
| GPQA Diamond · not specified | Hard reasoning | 96%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Academic table / GPQA Diamond / GPT‑6 Astra · reviewed 2026-09-06 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-06 |
| GPQA Diamond · not specified | Hard reasoning | 94.9%Reported settings & sourceLower-cost setting; exact effort not specified Provider-published result; preserves source setting without claiming a controlled cross-provider comparison. GPT-6 Astra: A new generation of intelligence · GPQA Diamond chart caption · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| GraphWalks · 256K to 1M BFS F1 | Supporting evidence | 71.8%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. All models self-computed. 200 problems with context length between 256K and 1M tokens. BFS F1, not pass rate. Provider-published launch claim, not independent measurement by Google for every row. All models self-computed. 200 problems with context length between 256K and 1M tokens. BFS F1, not pass rate. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 14: GraphWalks 256K to 1M BFS F1 / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| GraphWalks · up to 128K BFS F1 | Supporting evidence | 98.7%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. All models self-computed. 650 items with context length up to 128K tokens. BFS F1, not pass rate. Provider-published launch claim, not independent measurement by Google for every row. All models self-computed. 650 items with context length up to 128K tokens. BFS F1, not pass rate. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 13: GraphWalks up to 128K BFS F1 / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| Harvey's Legal Agent Benchmark · 1 | Supporting evidence | 5.4%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Results sourced from Vals AI. Provider-published launch claim, not independent measurement by Google for every row. Results sourced from Vals AI. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 4: Harvey's Legal Agent Benchmark 1 / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| HealthBench · not specified | Supporting evidence | 58.1 score (0-100)Reported settings & sourcelength-adjusted; official HealthBench scoring Mean response length 2258 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench / gpt-6-astra / length-adjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench · not specified | Supporting evidence | 59.7 score (0-100)Reported settings & sourceunadjusted; official HealthBench scoring Mean response length 2258 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench / gpt-6-astra / unadjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Consensus · not specified | Supporting evidence | 95.8 score (0-100)Reported settings & sourcelength-adjusted; official HealthBench scoring Mean response length 2237 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench Consensus / gpt-6-astra / length-adjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Consensus · not specified | Supporting evidence | 95.9 score (0-100)Reported settings & sourceunadjusted; official HealthBench scoring Mean response length 2237 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench Consensus / gpt-6-astra / unadjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Hard · not specified | Supporting evidence | 36.3 score (0-100)Reported settings & sourcelength-adjusted; official HealthBench scoring Mean response length 2192 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench Hard / gpt-6-astra / length-adjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Hard · not specified | Supporting evidence | 37.8 score (0-100)Reported settings & sourceunadjusted; official HealthBench scoring Mean response length 2192 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench Hard / gpt-6-astra / unadjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Professional · not specified | Supporting evidence | 63.4 score (0-100)Reported settings & sourcelength-adjusted; official HealthBench scoring Mean response length 4097 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench Professional / gpt-6-astra / length-adjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Professional · not specified | Supporting evidence | 69.5 score (0-100)Reported settings & sourceunadjusted; official HealthBench scoring Mean response length 4097 characters. Adjustment centered on2000characters; adjusted and unadjusted values remain distinct configurations. GPT-6 Astra System Card · Table6 / HealthBench Professional / gpt-6-astra / unadjusted · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| HealthBench Professional (length-adjusted) · not specified | Supporting evidence | 63.4%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API; official paper scoring; length-adjusted Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Science And Health table / HealthBench Professional (length-adjusted) / GPT‑6 Astra · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| Humanity's Last Exam (w/ tools) · not specified | Hard reasoning | 57.2%Reported settings & sourceMaximum reported across reasoning efforts; OpenAI research environment or API; tools enabled Provider-published result; comparator measurements are not automatically independently reproduced. GPT-6 Astra: A new generation of intelligence · Academic table / Humanity's Last Exam (w/ tools) / GPT‑6 Astra · reviewed 2026-09-06 | Published configurationcontributes to capability | lab self-report | Reviewed 2026-09-06 |