RankingReal-SWE

Real-SWE

Data updated 23 Sept 2026

Bucket
Supporting evidence
Unit
percent
Direction
Higher is better
Version
2026-09
Display harness
Real-SWE · Fable 5.1 · Claude Code
Board
https://realswe.withspecific.com/

Real-SWE ranks each model with its native harness. These rows are display only. They do not enter the weighted Overall or capability scores.

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

276–300 of 455 entries

ModelScoreEvidenceSource-recorded date
Mistral Large 2 (July 2024)Mistral
Mistral Large 2.1Mistral
Mistral Large 3Mistral
Mistral Medium 3Mistral
Mistral Medium 3.1Mistral
Mistral Medium 3.5Mistral
Mistral Nemo 12BMistral
Mistral Small 3.2Mistral
Mistral Small 4Mistral
Mistral Small CreativeMistral
Muse Glimmer 30BMeta
Muse Spark 1.1Meta
Muse Spark 1.2Meta
Muse Spark 1.3Meta
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16NVIDIA
North-Micro-Vision-InstructCohere
North-Mini-Code-1.0Cohere
NVIDIA Nemotron 3 UltraNVIDIA
NVIDIA-Nemotron-3-Nano-30B-A3B-BF16NVIDIA
NVIDIA-Nemotron-3-Nano-4B-BF16NVIDIA
NVIDIA-Nemotron-3-Super-120B-A12B-BF16NVIDIA
NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16NVIDIA
NVIDIA-Nemotron-Nano-12B-v2NVIDIA
NVIDIA-Nemotron-Nano-12B-v2-VL-BF16NVIDIA
NVIDIA-Nemotron-Nano-9B-v2NVIDIA

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Gemini 3.8 FlashGoogle31.2%Real-SWE · Gemini 3.8 Flash · Gemini CLIofficial board2026-09-23
GLM-5.3Z.ai28.8%Real-SWE · GLM 5.3 · Claude Codeofficial board2026-09-23
GPT-5.6 SolOpenAI16.2%Real-SWE · GPT-5.6 Sol · Codex CLIofficial board2026-09-23
GPT-6 AstraOpenAI33.8%Real-SWE · GPT-6 Astra · Codex CLIofficial board2026-09-23
Grok 4.6xAI32.5%Real-SWE · Grok 4.6 · Grok Buildofficial board2026-09-23
Kimi K3Moonshot18.8%Real-SWE · Kimi K3 · Kimi Codeofficial board2026-09-23
Muse Spark 1.3Meta23.8%Real-SWE · Muse Spark 1.3 · Muse Codeofficial board2026-09-23