RankingGPT-6 Astra
GPT-6 Astra
85 published benchmark measures · 13 benchmark families contribute across 5 task areas. 5 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →
Model evidence summary
This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →
Performance profile
Capabilities
Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.
Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.
Reported effort · Mixed settings
Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.
- Best across efforts: 34 observations
- High: 6 observations
- Low: 6 observations
- Max: 10 observations
- Medium: 6 observations
- XHigh: 7 observations
- Not specified: 62 observations
Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.
Inspect each result and its source ↓ · Download effort evidenceScore contributions and missing evidence
13 contributing families across 5 capabilities. Fixed reference panels do not change when the catalog expands.
Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.
Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.
Model information & shareable badge
- Lab
- OpenAI
- Catalog status
- active
- Availability
- Public provider catalog; account and region restrictions may apply
- Family
- GPT-6
- Released
- —
- Context
- 1,050,000 tokens
- License
- proprietary
- Model card
- https://developers.openai.com/api/docs/models/all
- Default Capability family coverage
/badge/gpt-6-astra.svg
Benchmark scores & sources
Original results, evaluation harnesses, and evidence behind this model.
| Benchmark | Bucket | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|---|
| TroubleshootingBench · 156 questions / 52 protocols | Supporting evidence | 48.44%Reported settings & sourceobserved performance Provider-published result; preserves source setting without claiming a controlled cross-provider comparison. GPT-6 Astra System Card · Section10.1.1.1 / TroubleshootingBench · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| TroubleshootingBench · 156 questions / 52 protocols | Supporting evidence | 63.46%Reported settings & sourcerefusal-adjusted upper estimate; refusals counted as successes Provider-published result; preserves source setting without claiming a controlled cross-provider comparison. GPT-6 Astra System Card · Section10.1.1.1 / TroubleshootingBench · reviewed 2026-09-06 | Published configuration | lab self-report | Reviewed 2026-09-06 |
| Vals Finance Agent · 2 | Supporting evidence | 53.5%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Results sourced from Vals AI. Provider-published launch claim, not independent measurement by Google for every row. Results sourced from Vals AI. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 3: Vals Finance Agent 2 / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| Vals Index | Supporting evidence | 63.1%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Vals AI composite, weighted by contribution to US GDP; overlapping component benchmarks do not add an aggregate ranking vote. Provider-published launch claim, not independent measurement by Google for every row. Vals AI composite, weighted by contribution to US GDP; overlapping component benchmarks do not add an aggregate ranking vote. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 1: Vals Index / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| Vibe Code Bench · 1.1 | Supporting evidence | 89.6%Reported settings & sourceComparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Results sourced from the official Vals AI public leaderboard. Provider-published launch claim, not independent measurement by Google for every row. Results sourced from the official Vals AI public leaderboard. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 7: Vibe Code Bench 1.1 / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30 | Published configuration | lab self-report | Reviewed 2026-09-30 |
| Warning circumvention · Sol 6.1 launch / safety stress test | Supporting evidence | 17.42%Reported settings & sourceReported reasoning effort max. Restriction-circumvention attempts in deliberately difficult low-stakes cases without full product safeguards. OpenAI research environment or API; same named metric and evaluation chart. No fallback is reported for this OpenAI configuration. Provider-published lab self-report. Safety stress outcomes are retained for inspection and excluded from capability scoring. Competitor results are republished from public reports; the page does not establish independent reproduction by OpenAI. Comparison limit: Safety failure behavior is not a capability or intelligence score. Introducing GPT-6.1 Sol · Chart: Warning circumvention (lower is better) / GPT-6 Astra / max · reviewed 2026-09-29 | Published configuration | lab self-report | Reviewed 2026-09-29 |
| GDPval-AA | Agentic | — | — | — | — |
| Humanity's Last Exam | Hard reasoning | — | — | — | — |
| LiveCodeBench | Coding | — | — | — | — |
| LMArena Text Arena | Human pref | — | — | — | — |
| MMLU-Pro | Knowledge | — | — | — | — |
| OSWorld-Verified | Agentic | — | — | — | — |
| SWE-bench Pro | Agentic | — | — | — | — |
| SWE-bench Verified | Agentic | — | — | — | — |
| Terminal-Bench 2.1 | Agentic | — | — | — | — |