RankingArtificial Analysis Cyber Index
Artificial Analysis Cyber Index
- Bucket
- Supporting evidence
- Unit
- index
- Direction
- Higher is better
- Version
- v1.0
- Display harness
- Artificial Analysis Stirrup · Cyber Index v1.0 · max
- Board
- https://artificialanalysis.ai/evaluations/artificial-analysis-cyber-index
Display only. This composite measures defensive source-code tasks. Successful capability scores depend on safety refusals, and refusal rates are reported separately. It does not enter weighted Overall.
Artificial Analysis v1.0, Stirrup. Equal mean of CWE-Bench-AA pass@1, DeepsecBench-AA median F2 over three repeats, and CyberGym-E2E-AA pass@1. DeepsecBench uses a GPT-5.6 Sol High judge. Public-model configurations retain their source effort and fallback labels on the effort and model pages. Trusted-access variants require a distinct catalog identity. Methodology
Compare published benchmark results with category weights →
Models
451–469 of 469 entries
Other harnesses
These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Gemini 3.8 FlashGoogle | 25.1449496510851 | Artificial Analysis Stirrup · Cyber Index v1.0 · high | official board | 2026-10-13 |
| GLM-5.3-FlashZ.ai | 49.9235527532159 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Grok 4.7xAI | 56.432341352642 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| MiMo-V2.6-ProXiaomi | 56.0656020403805 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| MiniMax-M3MiniMax | 22.3880159084502 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Mistral Large 4Mistral | 49.5113823968563 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Muse Spark 1.3Meta | 44.3048343397119 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| NVIDIA Nemotron 3 UltraNVIDIA | 13.0784136433712 | Artificial Analysis Stirrup · Cyber Index v1.0 · reasoning | official board | 2026-10-13 |
| Qwen3.8-27BQwen | 12.7243142724314 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| Step 5 PreviewStepFun | 47.7068149907409 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |