RankingDeepSWE 1.1 · 1.1
DeepSWE 1.1 · 1.1
- Bucket
- Coding
- Unit
- percent
- Direction
- Higher is better
- Version
- 1.1
- Display harness
- Qwen/Qwen3.8-2.4T-A95B
- Board
- https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
Compare published benchmark results with category weights →
Models
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| GPT-5.6 SolOpenAI | 73%Reported settings & sourceSource benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card. Best of Claude Code and mini-SWE-agent; Qwen best Claude Code; temp1,top_p.95,256K. First-party reported result. Qwen/Qwen3.8-2.4T-A95B · Performance table: DeepSWE 1.1 · reviewed 2026-09-12 | Qwen/Qwen3.8-2.4T-A95B | lab self-report | 2026-09-12 |
| Claude Fable 5Anthropic | 70%Reported settings & sourceSource benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card. Best of Claude Code and mini-SWE-agent; Qwen best Claude Code; temp1,top_p.95,256K. First-party reported result. Comparison limit: The source states that Fable 5 results may involve fallback execution; an exact configuration is not established. Qwen/Qwen3.8-2.4T-A95B · Performance table: DeepSWE 1.1 · reviewed 2026-09-12 | Qwen/Qwen3.8-2.4T-A95B | lab self-report | 2026-09-12 |
| Claude Opus 4.8Anthropic | 59%Reported settings & sourceSource benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card. Best of Claude Code and mini-SWE-agent; Qwen best Claude Code; temp1,top_p.95,256K. First-party reported result. Qwen/Qwen3.8-2.4T-A95B · Performance table: DeepSWE 1.1 · reviewed 2026-09-12 | Qwen/Qwen3.8-2.4T-A95B | lab self-report | 2026-09-12 |
| Qwen 3.8-MaxQwen | 56.6%Reported settings & sourceSource benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card. Best of Claude Code and mini-SWE-agent; Qwen best Claude Code; temp1,top_p.95,256K. First-party reported result. Qwen/Qwen3.8-2.4T-A95B · Performance table: DeepSWE 1.1 · reviewed 2026-09-12 | Qwen/Qwen3.8-2.4T-A95B | lab self-report | 2026-09-12 |
| Qwen3.7-maxQwen | 21.6%Reported settings & sourceSource benchmark-specific methodology; Qwen benchmark effort unspecified, GPT-5.6 Sol max per table header. Max in Qwen model names is not a reported effort setting. Comparator settings and source citations as documented in the model card. Best of Claude Code and mini-SWE-agent; Qwen best Claude Code; temp1,top_p.95,256K. First-party reported result. Qwen/Qwen3.8-2.4T-A95B · Performance table: DeepSWE 1.1 · reviewed 2026-09-12 | Qwen/Qwen3.8-2.4T-A95B | lab self-report | 2026-09-12 |