RankingAutomationBench · public v3
AutomationBench · public v3
- Bucket
- Agentic
- Unit
- percent
- Direction
- Higher is better
- Version
- public v3
- Display harness
- Muse Spark1.3 evaluation methodology
- Board
- https://research.meta.ai/static/muse-spark-1-3-multimodal-evaluation-methodology
Compare published benchmark results with category weights →
Models
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Opus 5Anthropic | 50.3%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.3Meta | 49.6%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| GPT-5.6 SolOpenAI | 46.7%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.2Meta | 38.2%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning xhigh Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.3Meta | 48.3%Reported settings & source600public workflow tasks; deterministic end-state assertions;pass@1; reasoning xhigh Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |