RankingDeepSearchQA · source release snapshot; version not specified

DeepSearchQA · source release snapshot; version not specified

Data updated 22 Nov 2026

DeepSearchQA · source release snapshot; version not specified is published here as its own result table, version source release snapshot; version not specified. Scores use percent, and higher values rank better. The display harness is Muse Spark 1.1 evaluation report Figure44. Data updated 22 Nov 2026.

Bucket
Agentic
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
Muse Spark 1.1 evaluation report Figure44
Board
https://research.meta.ai/static/muse-spark-1-1-evaluation-report

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–4 of 4 entries

ModelScoreHarnessEvidenceSource-recorded date
GPT-5.5OpenAI87.8%
Reported settings & source

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Muse Spark 1.1 evaluation report Figure44lab self-report2026-09-06
Muse Spark 1.1Meta84.9%
Reported settings & source

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Muse Spark 1.1 evaluation report Figure44lab self-report2026-09-06
Claude Opus 4.8Anthropic84.3%
Reported settings & source

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Muse Spark 1.1 evaluation report Figure44lab self-report2026-09-06
Gemini 3.1 ProGoogle71.3%
Reported settings & source

Meta Model API xhigh; Gemini high; Opus max; GPT xhigh. Best of self-reported or Meta reproduction unless specified. OSWorld GUI only; Terminal bash only5attempts89tasks6CPU8GB; DeepSWE no internet5attempts.

First-party reported result; comparator results retain the source evaluation setup.

Muse Spark 1.1 evaluation report Figure44 · Figure44 physical page101; methodology pages101–105 · reviewed 2026-09-06

Muse Spark 1.1 evaluation report Figure44lab self-report2026-09-06