RankingDeepSearchQA

DeepSearchQA

Data updated 12 Sept 2026

Bucket
Agentic
Unit
index
Direction
Higher is better
Version
Display harness
Muse Spark1.3 evaluation methodology
Board
https://research.meta.ai/static/muse-spark-1-3-multimodal-evaluation-methodology

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
GPT-5.6 SolOpenAI93.1 percent F1
Reported settings & source

900questions; common search backend/browser harness; answer-set F1; reasoning max

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Claude Opus 5Anthropic90.4 percent F1
Reported settings & source

900questions; common search backend/browser harness; answer-set F1; reasoning max

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Muse Spark 1.3Meta90.3 percent F1
Reported settings & source

900questions; common search backend/browser harness; answer-set F1; reasoning max

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Muse Spark 1.2Meta85.9 percent F1
Reported settings & source

900questions; common search backend/browser harness; answer-set F1; reasoning xhigh

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Muse Spark 1.3Meta89.4 percent F1
Reported settings & source

900questions; common search backend/browser harness; answer-set F1; reasoning xhigh

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06