RankingOSWorld · 2.0 offline partial score

OSWorld · 2.0 offline partial score

Data updated 30 Sept 2026

Bucket: Agentic
Unit: percent
Direction: Higher is better
Version: 2.0 offline partial score
Display harness: Google Gemini 4 Argon launch and evaluation methodology
Board: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-4-argon/

The available records have no admitted matched comparison in the capability core. Raw results remain available below.

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–2 of 2 entries

Model	Score	Harness	Evidence	Source-recorded date
Gemini 4 ArgonGoogle	69.2% Reported settings & source Gemini API highest thinking settings; exact named effort not specified by Google. Argon self-computed, maximum of three single-attempt runs; offline subset partial score. Official Docker/evaluator, 1080p, 500 steps, Gemini CUA harness, parallel batch tools, compaction, pyautogui actuation, screenshot-only observations, UI-specific function declarations, safety filters, official 08.08 patch. Astra from its official blog. Anthropic combined online/offline results are excluded. Provider-published launch claim, not independent measurement by Google for every row. Argon self-computed, maximum of three single-attempt runs; offline subset partial score. Official Docker/evaluator, 1080p, 500 steps, Gemini CUA harness, parallel batch tools, compaction, pyautogui actuation, screenshot-only observations, UI-specific function declarations, safety filters, official 08.08 patch. Astra from its official blog. Anthropic combined online/offline results are excluded. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 16: OSWorld 2.0 offline partial score / Gemini 4 Argon; methodology Additional Details · reviewed 2026-09-30	Google Gemini 4 Argon launch and evaluation methodology	lab self-report	2026-09-30
GPT-6 AstraOpenAI	72.6% Reported settings & source Comparator maximum available thinking/reasoning when reported, otherwise best available result; exact setting not identified by this grid. Argon self-computed, maximum of three single-attempt runs; offline subset partial score. Official Docker/evaluator, 1080p, 500 steps, Gemini CUA harness, parallel batch tools, compaction, pyautogui actuation, screenshot-only observations, UI-specific function declarations, safety filters, official 08.08 patch. Astra from its official blog. Anthropic combined online/offline results are excluded. Provider-published launch claim, not independent measurement by Google for every row. Argon self-computed, maximum of three single-attempt runs; offline subset partial score. Official Docker/evaluator, 1080p, 500 steps, Gemini CUA harness, parallel batch tools, compaction, pyautogui actuation, screenshot-only observations, UI-specific function declarations, safety filters, official 08.08 patch. Astra from its official blog. Anthropic combined online/offline results are excluded. Methodology https://deepmind.google/models/evals-methodology/gemini-4-argon, SHA256 ff1df6bdeddc4c0f48840c09a8a7813b10ae7ad9e053892da68dabf64f09bff7. Preserve source rounding. Methodology says capabilities as of September 2026 and results as of October 2026; review date is source retrieval, not evaluation date. Comparison limit: Provider-published claim. Independent source results are admitted separately with exact checkpoint, effort and compatible protocol; this grid does not establish a matched comparison. Google Gemini 4 Argon launch and evaluation methodology · Launch grid row 16: OSWorld 2.0 offline partial score / GPT-6 Astra; methodology Additional Details · reviewed 2026-09-30	Google Gemini 4 Argon launch and evaluation methodology	lab self-report	2026-09-30