RankingAutomationBench-AA
AutomationBench-AA
- Bucket
- Supporting evidence
- Unit
- percent
- Direction
- Higher is better
- Version
- aa-score
- Display harness
- Artificial Analysis AutomationBench-AA
- Board
- https://artificialanalysis.ai/evaluations/automationbench-aa
AutomationBench-AA score: share of task objectives completed with no guardrail violation, on Artificial Analysis's private 657-task holdout. This is not Zapier's tasks-completed rate. The effort dataset already includes this evaluation in the agentic family under the existing equal-family budget. These rows are the board, not a second weight.
Compare published benchmark results with category weights →
Models
201–225 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| GLM-4.7-FlashZ.ai | — | — | — |
| GLM-4.7-FlashXZ.ai | — | — | — |
| glm-4v-9bZ.ai | — | — | — |
| GLM-5Z.ai | — | — | — |
| GLM-5-TurboZ.ai | — | — | — |
| GLM-5.1Z.ai | — | — | — |
| GLM-5.2Z.ai | — | — | — |
| GLM-5.3Z.ai | — | — | — |
| GLM-5V-TurboZ.ai | — | — | — |
| glm-edge-1.5b-chatZ.ai | — | — | — |
| glm-edge-4b-chatZ.ai | — | — | — |
| glm-edge-v-2bZ.ai | — | — | — |
| glm-edge-v-5bZ.ai | — | — | — |
| GLM-Z1-32B-0414Z.ai | — | — | — |
| GLM-Z1-9B-0414Z.ai | — | — | — |
| GLM-Z1-Rumination-32B-0414Z.ai | — | — | — |
| GPT-3.5-turboOpenAI | — | — | — |
| GPT-3.5-turbo-1106OpenAI | — | — | — |
| GPT-3.5-turbo-instructOpenAI | — | — | — |
| GPT-4OpenAI | — | — | — |
| GPT-4-turboOpenAI | — | — | — |
| GPT-4.1OpenAI | — | — | — |
| GPT-4.1 MiniOpenAI | — | — | — |
| GPT-4.1-nanoOpenAI | — | — | — |
| GPT-4oOpenAI | — | — | — |