RankingAutomationBench-AA
AutomationBench-AA
- Bucket
- Supporting evidence
- Unit
- percent
- Direction
- Higher is better
- Version
- aa-score
- Display harness
- Artificial Analysis AutomationBench-AA
- Board
- https://artificialanalysis.ai/evaluations/automationbench-aa
AutomationBench-AA score: share of task objectives completed with no guardrail violation, on Artificial Analysis's private 657-task holdout. This is not Zapier's tasks-completed rate. The effort dataset already includes this evaluation in the agentic family under the existing equal-family budget. These rows are the board, not a second weight.
Compare published benchmark results with category weights →
Models
226–250 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| GPT-4o MiniOpenAI | — | — | — |
| GPT-5OpenAI | — | — | — |
| GPT-5 NanoOpenAI | — | — | — |
| GPT-5 ProOpenAI | — | — | — |
| GPT-5.1OpenAI | — | — | — |
| GPT-5.2OpenAI | — | — | — |
| GPT-5.2 ProOpenAI | — | — | — |
| GPT-5.3 CodexOpenAI | — | — | — |
| GPT-5.3 Codex SparkOpenAI | — | — | — |
| GPT-5.4OpenAI | — | — | — |
| GPT-5.4 MiniOpenAI | — | — | — |
| GPT-5.4 NanoOpenAI | — | — | — |
| GPT-5.4 ProOpenAI | — | — | — |
| GPT-5.5OpenAI | — | — | — |
| GPT-5.5 ProOpenAI | — | — | — |
| GPT-5.6 LunaOpenAI | — | — | — |
| GPT-5.6 TerraOpenAI | — | — | — |
| GPT-6.1 SolOpenAI | — | — | — |
| Grok-4.20-0309-non-reasoningxAI | — | — | — |
| Grok-4.20-0309-reasoningxAI | — | — | — |
| Grok-4.20-multi-agent-0309xAI | — | — | — |
| Grok-4.3xAI | — | — | — |
| Grok-4.5xAI | — | — | — |
| Grok-build-0.1xAI | — | — | — |
| Hunyuan A52B InstructTencent | — | — | — |