RankingAutomationBench · public v3

AutomationBench · public v3

Data updated 22 Nov 2026

AutomationBench · public v3 is published here as its own result table, version public v3. Scores use percent, and higher values rank better. The display harness is Muse Spark1.3 evaluation methodology. Data updated 22 Nov 2026.

Bucket
Agentic
Unit
percent
Direction
Higher is better
Version
public v3
Display harness
Muse Spark1.3 evaluation methodology
Board
https://research.meta.ai/static/muse-spark-1-3-multimodal-evaluation-methodology

Compare published benchmark results with category weights →

Models

Published configurations retain their source and harness labels. Missing results remain unknown.

1–5 of 5 entries

ModelScoreHarnessEvidenceSource-recorded date
Claude Opus 5Anthropic50.3%
Reported settings & source

600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Muse Spark 1.3Meta49.6%
Reported settings & source

600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
GPT-5.6 SolOpenAI46.7%
Reported settings & source

600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Muse Spark 1.2Meta38.2%
Reported settings & source

600public workflow tasks; deterministic end-state assertions;pass@1; reasoning xhigh

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06
Muse Spark 1.3Meta48.3%
Reported settings & source

600public workflow tasks; deterministic end-state assertions;pass@1; reasoning xhigh

Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06

Muse Spark1.3 evaluation methodologylab self-report2026-09-06