RankingAutomationBench (Public) · source release snapshot; version not specified
AutomationBench (Public) · source release snapshot; version not specified
- Bucket
- Agentic
- Unit
- percent
- Direction
- Higher is better
- Version
- source release snapshot; version not specified
- Display harness
- deepseek-ai/DeepSeek-V4-Pro-0813
- Board
- https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813
Compare published benchmark results with category weights →
Models
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| DeepSeek V4-Pro 0813DeepSeek | 31.8%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| Kimi K3Moonshot | 30.8%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| Claude Fable 5Anthropic | 29.1%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. Comparison limit: The source labels this column Fable-5 (w/ fallback); it does not establish standalone Fable 5 performance. Retained as published evidence, excluded from comparable ranking inputs. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| Claude Opus 4.8Anthropic | 27.2%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| DeepSeek-V4-Flash-0731DeepSeek | 25.1%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| GLM-5.2Z.ai | 12.9%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: AutomationBench (Public) · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |