RankingAutomationBench-AA
AutomationBench-AA
- Bucket
- Supporting evidence
- Unit
- percent
- Direction
- Higher is better
- Version
- aa-score
- Display harness
- Artificial Analysis AutomationBench-AA
- Board
- https://artificialanalysis.ai/evaluations/automationbench-aa
AutomationBench-AA score: share of task objectives completed with no guardrail violation, on Artificial Analysis's private 657-task holdout. This is not Zapier's tasks-completed rate. The effort dataset already includes this evaluation in the agentic family under the existing equal-family budget. These rows are the board, not a second weight.
Compare published benchmark results with category weights →
Models
351–375 of 471 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| Qianfan-VL-70BBaidu | — | — | — |
| Qianfan-VL-8BBaidu | — | — | — |
| QVQ-maxQwen | — | — | — |
| QVQ-plusQwen | — | — | — |
| Qwen-coder-plusQwen | — | — | — |
| Qwen-coder-turboQwen | — | — | — |
| Qwen-flashQwen | — | — | — |
| Qwen-flash-characterQwen | — | — | — |
| Qwen-longQwen | — | — | — |
| Qwen-math-plusQwen | — | — | — |
| Qwen-math-turboQwen | — | — | — |
| Qwen-maxQwen | — | — | — |
| Qwen-omni-turboQwen | — | — | — |
| Qwen-plusQwen | — | — | — |
| Qwen-plus-characterQwen | — | — | — |
| Qwen-plus-character-jaQwen | — | — | — |
| Qwen-turboQwen | — | — | — |
| Qwen-vl-maxQwen | — | — | — |
| Qwen-vl-plusQwen | — | — | — |
| Qwen3-0.6BQwen | — | — | — |
| Qwen3-1.7BQwen | — | — | — |
| Qwen3-14BQwen | — | — | — |
| Qwen3-235B-A22BQwen | — | — | — |
| Qwen3-235B-A22B-Instruct-2507Qwen | — | — | — |
| Qwen3-235B-A22B-Thinking-2507Qwen | — | — | — |