RankingArtificial Analysis Cyber Index
Artificial Analysis Cyber Index
- Bucket
- Supporting evidence
- Unit
- index
- Direction
- Higher is better
- Version
- v1.0
- Display harness
- Artificial Analysis Stirrup · Cyber Index v1.0 · max
- Board
- https://artificialanalysis.ai/evaluations/artificial-analysis-cyber-index
Display only. This composite measures defensive source-code tasks. Successful capability scores depend on safety refusals, and refusal rates are reported separately. It does not enter weighted Overall.
Artificial Analysis v1.0, Stirrup. Equal mean of CWE-Bench-AA pass@1, DeepsecBench-AA median F2 over three repeats, and CyberGym-E2E-AA pass@1. DeepsecBench uses a GPT-5.6 Sol High judge. Public-model configurations retain their source effort and fallback labels on the effort and model pages. Trusted-access variants require a distinct catalog identity. Methodology
Compare published benchmark results with category weights →
Models
151–175 of 469 entries
| Model | Score | Evidence | Source-recorded date |
|---|---|---|---|
| glm-4-9b-chatZ.ai | — | — | — |
| glm-4-9b-chat-1mZ.ai | — | — | — |
| GLM-4.1V-9B-ThinkingZ.ai | — | — | — |
| GLM-4.5Z.ai | — | — | — |
| GLM-4.5-AirZ.ai | — | — | — |
| GLM-4.5-AirXZ.ai | — | — | — |
| GLM-4.5-FlashZ.ai | — | — | — |
| GLM-4.5-XZ.ai | — | — | — |
| GLM-4.5VZ.ai | — | — | — |
| GLM-4.6Z.ai | — | — | — |
| GLM-4.6VZ.ai | — | — | — |
| GLM-4.6V-FlashZ.ai | — | — | — |
| GLM-4.6V-FlashXZ.ai | — | — | — |
| GLM-4.7Z.ai | — | — | — |
| GLM-4.7-FlashZ.ai | — | — | — |
| GLM-4.7-FlashXZ.ai | — | — | — |
| glm-4v-9bZ.ai | — | — | — |
| GLM-5Z.ai | — | — | — |
| GLM-5-TurboZ.ai | — | — | — |
| GLM-5.1Z.ai | — | — | — |
| GLM-5.2Z.ai | — | — | — |
| GLM-5.3-FlashZ.ai | — | — | — |
| GLM-5V-TurboZ.ai | — | — | — |
| glm-edge-1.5b-chatZ.ai | — | — | — |
| glm-edge-4b-chatZ.ai | — | — | — |
Other harnesses
These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Gemini 3.8 FlashGoogle | 25.1449496510851 | Artificial Analysis Stirrup · Cyber Index v1.0 · high | official board | 2026-10-13 |
| GLM-5.3-FlashZ.ai | 49.9235527532159 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Grok 4.7xAI | 56.432341352642 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| MiMo-V2.6-ProXiaomi | 56.0656020403805 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| MiniMax-M3MiniMax | 22.3880159084502 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Mistral Large 4Mistral | 49.5113823968563 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |
| Muse Spark 1.3Meta | 44.3048343397119 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| NVIDIA Nemotron 3 UltraNVIDIA | 13.0784136433712 | Artificial Analysis Stirrup · Cyber Index v1.0 · reasoning | official board | 2026-10-13 |
| Qwen3.8-27BQwen | 12.7243142724314 | Artificial Analysis Stirrup · Cyber Index v1.0 · xhigh | official board | 2026-10-13 |
| Step 5 PreviewStepFun | 47.7068149907409 | Artificial Analysis Stirrup · Cyber Index v1.0 · unspecified | official board | 2026-10-13 |