RankingNL2Repo · source release snapshot; version not specified
NL2Repo · source release snapshot; version not specified
- Bucket
- Supporting evidence
- Unit
- percent
- Direction
- Higher is better
- Version
- source release snapshot; version not specified
- Display harness
- deepseek-ai/DeepSeek-V4-Pro-0813
- Board
- https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813
The available records have no admitted matched comparison in the capability core. Raw results remain available below.
Compare published benchmark results with category weights →
Models
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Claude Opus 4.8Anthropic | 69.7%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: NL2Repo · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| DeepSeek V4-Pro 0813DeepSeek | 61.5%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: NL2Repo · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| DeepSeek-V4-Flash-0731DeepSeek | 54.2%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: NL2Repo · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| GLM-5.2Z.ai | 48.9%Reported settings & sourceDeepSeek updated 0813/0731 release evaluation table; tool/harness settings per model card. First-party reported result. deepseek-ai/DeepSeek-V4-Pro-0813 · Performance table: NL2Repo · reviewed 2026-09-12 | deepseek-ai/DeepSeek-V4-Pro-0813 | lab self-report | 2026-09-12 |
| Claude Opus 4.7Anthropic | 56.3%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| Claude Opus 4.8Anthropic | 69.7%Reported settings & sourceGLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12 | zai-org/GLM-5.3 | lab self-report | 2026-09-12 |
| DeepSeek V4-Pro 0813DeepSeek | 61.1%Reported settings & sourceGLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12 | zai-org/GLM-5.3 | lab self-report | 2026-09-12 |
| Gemini 3.1 ProGoogle | 21.6%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| GLM-5.1Z.ai | 41%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| GLM-5.2Z.ai | 48.9%Reported settings & sourceGLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12 | zai-org/GLM-5.3 | lab self-report | 2026-09-12 |
| GLM-5.3Z.ai | 58%Reported settings & sourceGLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12 | zai-org/GLM-5.3 | lab self-report | 2026-09-12 |
| GPT-5.5OpenAI | 52.9%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| Kimi K3Moonshot | 58%Reported settings & sourceGLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12 | zai-org/GLM-5.3 | lab self-report | 2026-09-12 |
| Kimi-K2.6Moonshot | 42.8%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| MiniMax-M2.7MiniMax | 35%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| MiniMax-M3MiniMax | 42.1%Reported settings & sourceMiniMax launch figure methodology. SWE internal ClaudeCode 4 runs; Terminal 8CPU16GB2h128k Terminus2; Paper/PostTrain Ralph-loop12h; GDPval internal rubric grader; BrowseComp discard64k; OSWorld361tasks. Comparator provider/leaderboard scores where footnoted. First-party reported result; comparator results retain the source evaluation setup. MiniMax M3 model card benchmark figure · figures/benchmark.jpeg · reviewed 2026-09-06 | MiniMax M3 model card benchmark figure | lab self-report | 2026-09-06 |
| Qwen 3.8-MaxQwen | 55.9%Reported settings & sourceGLM-5.3 release table; benchmark-specific harness and reasoning configurations in Evaluation Details. First-party reported result. zai-org/GLM-5.3 · Performance table: NL2Repo · reviewed 2026-09-12 | zai-org/GLM-5.3 | lab self-report | 2026-09-12 |