RankingAutomationBench · public v3
AutomationBench · public v3
AutomationBench · public v3 is published here as its own result table, version public v3. Scores use percent, and higher values rank better. The display harness is Muse Spark1.3 evaluation methodology. Data updated 22 Nov 2026.
- Bucket
- Agentic
- Unit
- percent
- Direction
- Higher is better
- Version
- public v3
- Display harness
- Muse Spark1.3 evaluation methodology
- Board
- https://research.meta.ai/static/muse-spark-1-3-multimodal-evaluation-methodology
Compare published benchmark results with category weights →
Models
1–5 of 5 entries
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Opus 5Anthropic | 50.3%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.3Meta | 49.6%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| GPT-5.6 SolOpenAI | 46.7%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.2Meta | 38.2%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning xhigh Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.3Meta | 48.3%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning xhigh Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |