RankingReal-SWE

Real-SWE

Data updated 23 Sept 2026

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
2026-09
Display harness
Real-SWE · Fable 5.1 · Claude Code
Board
https://realswe.withspecific.com/

Real-SWE ranks each model with its native harness. These rows are display only. They do not enter the weighted Overall or capability scores.

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

51–75 of 455 entries

ModelScoreEvidenceSource-recorded date
Command A Translate 08 2025Cohere
Command A Vision 07 2025Cohere
Command LightCohere
Command R 03 2024Cohere
Command R 08 2024Cohere
Command R Plus 04 2024Cohere
Command R Plus 08 2024Cohere
Command R7B 12 2024Cohere
DeepSeek V4 Flash 0424DeepSeek
DeepSeek V4-Pro 0424DeepSeek
DeepSeek V4-Pro 0813DeepSeek
DeepSeek-R1-0528DeepSeek
DeepSeek-R1-0528-Qwen3-8BDeepSeek
DeepSeek-R1-Distill-Llama-70BDeepSeek
DeepSeek-R1-Distill-Llama-8BDeepSeek
DeepSeek-R1-Distill-Qwen-1.5BDeepSeek
DeepSeek-R1-Distill-Qwen-14BDeepSeek
DeepSeek-R1-Distill-Qwen-32BDeepSeek
DeepSeek-R1-Distill-Qwen-7BDeepSeek
DeepSeek-V3.2DeepSeek
DeepSeek-V3.2-SpecialeDeepSeek
DeepSeek-V4-Flash-0731DeepSeek
DeepSeek-V4-Flash-Vision-ExpDeepSeek
Devstral 2Mistral
Devstral Medium 1.0Mistral

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Gemini 3.8 FlashGoogle31.2%Real-SWE · Gemini 3.8 Flash · Gemini CLIofficial board2026-09-23
GLM-5.3Z.ai28.8%Real-SWE · GLM 5.3 · Claude Codeofficial board2026-09-23
GPT-5.6 SolOpenAI16.2%Real-SWE · GPT-5.6 Sol · Codex CLIofficial board2026-09-23
GPT-6 AstraOpenAI33.8%Real-SWE · GPT-6 Astra · Codex CLIofficial board2026-09-23
Grok 4.6xAI32.5%Real-SWE · Grok 4.6 · Grok Buildofficial board2026-09-23
Kimi K3Moonshot18.8%Real-SWE · Kimi K3 · Kimi Codeofficial board2026-09-23
Muse Spark 1.3Meta23.8%Real-SWE · Muse Spark 1.3 · Muse Codeofficial board2026-09-23