RankingArtificial Analysis Cyber Index
Artificial Analysis Cyber Index
- Bucket
- Supporting evidence
- Unit
- index
- Direction
- Higher is better
- Version
- v1.0
- Display harness
- Artificial Analysis Stirrup · Cyber Index v1.0 · max
- Board
- https://artificialanalysis.ai/evaluations/artificial-analysis-cyber-index
Display only. This composite measures defensive source-code tasks. Successful capability scores depend on safety refusals, and refusal rates are reported separately. It does not enter weighted Overall.
Artificial Analysis v1.0, Stirrup. Equal mean of CWE-Bench-AA pass@1, DeepsecBench-AA median F2 over three repeats, and CyberGym-E2E-AA pass@1. DeepsecBench uses a GPT-5.6 Sol High judge. Public-model configurations retain their source effort and fallback labels on the effort and model pages. Trusted-access variants require a distinct catalog identity. Methodology
Compare published benchmark results with category weights →
Models
1–25 of 469 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| GPT-6 LunaOpenAI | 52.6853594148008 | official board | 2026-10-13 |
| Kimi K3Moonshot | 41.2676448723918 | official board | 2026-10-13 |
| DeepSeek V4.1 FlashDeepSeek | 40.81131888823 | official board | 2026-10-13 |
| GPT-6 SolOpenAI | 36.8274946268674 | official board | 2026-10-13 |
| GLM-5.3Z.ai | 36.3757005819883 | official board | 2026-10-13 |
| GPT-6 AstraOpenAI | 33.4198270126414 | official board | 2026-10-13 |
| Claude Opus 5.5Anthropic | 28.6636152579411 | official board | 2026-10-13 |
| Claude Fable 5.1Anthropic | 25.0195230207051 | official board | 2026-10-13 |
| Agnes 2.5 Pro AlphaAgnes AI | — | — | — |
| Agnes-3.0-Flash PreviewAgnes AI | — | — | — |
| Amazon Nova 2 LiteAmazon | — | — | — |
| Amazon Nova 2 Pro PreviewAmazon | — | — | — |
| Amazon Nova LiteAmazon | — | — | — |
| Amazon Nova MicroAmazon | — | — | — |
| Amazon Nova PremierAmazon | — | — | — |
| Amazon Nova ProAmazon | — | — | — |
| AutoGLM-Phone-9BZ.ai | — | — | — |
| AutoGLM-Phone-9B-MultilingualZ.ai | — | — | — |
| aya-101Cohere | — | — | — |
| aya-23-35BCohere | — | — | — |
| aya-23-8BCohere | — | — | — |
| aya-expanse-8bCohere | — | — | — |
| aya-vision-8bCohere | — | — | — |
| C4Ai Aya Expanse 32BCohere | — | — | — |
| C4Ai Aya Vision 32BCohere | — | — | — |
Other harnesses
These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Gemini 3.8 FlashGoogle | 25.1449496510851 | Artificial Analysis Stirrup · Cyber Index v1.0 · high | official board | 2026-10-13 |
| GLM-5.3-FlashZ.ai | 49.9235527532159 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Grok 4.7xAI | 56.432341352642 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| MiMo-V2.6-ProXiaomi | 56.0656020403805 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| MiniMax-M3MiniMax | 22.3880159084502 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Mistral Large 4Mistral | 49.5113823968563 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Muse Spark 1.3Meta | 44.3048343397119 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| NVIDIA Nemotron 3 UltraNVIDIA | 13.0784136433712 | Artificial Analysis Stirrup · Cyber Index v1.0 · reasoning | official board | 2026-10-13 |
| Qwen3.8-27BQwen | 12.7243142724314 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| Step 5 PreviewStepFun | 47.7068149907409 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |