UnifyBench

RankingArtificial Analysis Cyber Index

Artificial Analysis Cyber Index

Data updated 13 Oct 2026

Bucket
Supporting evidence
Unit
index
Direction
Higher is better
Version
v1.0
Display harness
Artificial Analysis Stirrup · Cyber Index v1.0 · max
Board
https://artificialanalysis.ai/evaluations/artificial-analysis-cyber-index

Display only. This composite measures defensive source-code tasks. Successful capability scores depend on safety refusals, and refusal rates are reported separately. It does not enter weighted Overall.

Artificial Analysis v1.0, Stirrup. Equal mean of CWE-Bench-AA pass@1, DeepsecBench-AA median F2 over three repeats, and CyberGym-E2E-AA pass@1. DeepsecBench uses a GPT-5.6 Sol High judge. Public-model configurations retain their source effort and fallback labels on the effort and model pages. Trusted-access variants require a distinct catalog identity. Methodology

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

401–425 of 469 entries

ModelScoreEvidenceSource-recorded date
Qwen3.5-0.8BQwen———
Qwen3.5-122B-A10BQwen———
Qwen3.5-27BQwen———
Qwen3.5-2BQwen———
Qwen3.5-35B-A3BQwen———
Qwen3.5-397B-A17BQwen———
Qwen3.5-4BQwen———
Qwen3.5-9BQwen———
Qwen3.5-flashQwen———
Qwen3.5-omni-flashQwen———
Qwen3.5-omni-plusQwen———
Qwen3.5-plusQwen———
Qwen3.6-27BQwen———
Qwen3.6-35B-A3BQwen———
Qwen3.6-flashQwen———
Qwen3.6-plusQwen———
Qwen3.7-flashQwen———
Qwen3.7-maxQwen———
Qwen3.7-plusQwen———
Qwen3.8 Max 0902Qwen———
Qwen3.8-2.4T-A95BQwen———
Qwen3.8-27BQwen———
Qwen3.8-flashQwen———
Qwen3.8-Flash-NextQwen———
QwQ-plusQwen———

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Gemini 3.8 FlashGoogle25.1449496510851 Artificial Analysis Stirrup · Cyber Index v1.0 · highofficial board2026-10-13
GLM-5.3-FlashZ.ai49.9235527532159 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
Grok 4.7xAI56.432341352642 Artificial Analysis Stirrup · Cyber Index v1.0 · xhighofficial board2026-10-13
MiMo-V2.6-ProXiaomi56.0656020403805 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
MiniMax-M3MiniMax22.3880159084502 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
Mistral Large 4Mistral49.5113823968563 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
Muse Spark 1.3Meta44.3048343397119 Artificial Analysis Stirrup · Cyber Index v1.0 · xhighofficial board2026-10-13
NVIDIA Nemotron 3 UltraNVIDIA13.0784136433712 Artificial Analysis Stirrup · Cyber Index v1.0 · reasoningofficial board2026-10-13
Qwen3.8-27BQwen12.7243142724314 Artificial Analysis Stirrup · Cyber Index v1.0 · xhighofficial board2026-10-13
Step 5 PreviewStepFun47.7068149907409 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13