RankingAutomationBench-AA
AutomationBench-AA
- Bucket
- Supporting evidence
- Unit
- percent
- Direction
- Higher is better
- Version
- aa-score
- Display harness
- Artificial Analysis AutomationBench-AA
- Board
- https://artificialanalysis.ai/evaluations/automationbench-aa
AutomationBench-AA score: share of task objectives completed with no guardrail violation, on Artificial Analysis's private 657-task holdout. This is not Zapier's tasks-completed rate. The effort dataset already includes this evaluation in the agentic family under the existing equal-family budget. These rows are the board, not a second weight.
Compare published benchmark results with category weights →
Models
176–200 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| Gemma 3 4B ITGoogle | — | — | — |
| Gemma 3n E2B ITGoogle | — | — | — |
| Gemma 3n E4B ITGoogle | — | — | — |
| Gemma 4 12B ITGoogle | — | — | — |
| Gemma 4 26B-A4B ITGoogle | — | — | — |
| Gemma 4 31B ITGoogle | — | — | — |
| Gemma 4 E2B ITGoogle | — | — | — |
| Gemma 4 E4B ITGoogle | — | — | — |
| GLM-4-32B-0414Z.ai | — | — | — |
| GLM-4-32B-0414-128KZ.ai | — | — | — |
| GLM-4-9B-0414Z.ai | — | — | — |
| glm-4-9b-chatZ.ai | — | — | — |
| glm-4-9b-chat-1mZ.ai | — | — | — |
| GLM-4.1V-9B-ThinkingZ.ai | — | — | — |
| GLM-4.5Z.ai | — | — | — |
| GLM-4.5-AirZ.ai | — | — | — |
| GLM-4.5-AirXZ.ai | — | — | — |
| GLM-4.5-FlashZ.ai | — | — | — |
| GLM-4.5-XZ.ai | — | — | — |
| GLM-4.5VZ.ai | — | — | — |
| GLM-4.6Z.ai | — | — | — |
| GLM-4.6VZ.ai | — | — | — |
| GLM-4.6V-FlashZ.ai | — | — | — |
| GLM-4.6V-FlashXZ.ai | — | — | — |
| GLM-4.7Z.ai | — | — | — |