RankingSWE-Atlas Codebase QnA
SWE-Atlas Codebase QnA
SWE-Atlas Codebase QnA is published here as its own result table. Scores use percent, and higher values rank better. The display harness is Muse Spark1.3 evaluation methodology. Data updated 22 Nov 2026.
- Bucket
- Supporting evidence
- Unit
- percent
- Direction
- Higher is better
- Version
- —
- Display harness
- Muse Spark1.3 evaluation methodology
- Board
- https://research.meta.ai/static/muse-spark-1-3-multimodal-evaluation-methodology
The available records have no admitted matched comparison in the capability core. Raw results remain available below.
Compare published benchmark results with category weights →
Models
1–5 of 5 entries
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Muse Spark 1.3Meta | 59.4%Reported settings & source124tasks/11repos; publicQnA mini-swe-agent rubric pass@1; GPT/Opus owncards; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| GPT-5.6 SolOpenAI | 53.5%Reported settings & source124tasks/11repos; publicQnA mini-swe-agent rubric pass@1; GPT/Opus owncards; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Claude Opus 5Anthropic | 52.7%Reported settings & source124tasks/11repos; publicQnA mini-swe-agent rubric pass@1; GPT/Opus owncards; reasoning max Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.2Meta | 46.2%Reported settings & source124tasks/11repos; publicQnA mini-swe-agent rubric pass@1; GPT/Opus owncards; reasoning xhigh Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |
| Muse Spark 1.3Meta | 54%Reported settings & source124tasks/11repos; publicQnA mini-swe-agent rubric pass@1; GPT/Opus owncards; reasoning xhigh Muse Spark1.3 evaluation methodology · PDF page4 performance table · reviewed 2026-09-06 | Muse Spark1.3 evaluation methodology | lab self-report | 2026-09-06 |