RankingArtificial Analysis Cyber Index

Artificial Analysis Cyber Index

Data updated 13 Oct 2026

Bucket
Supporting evidence
Unit
index
Direction
Higher is better
Version
v1.0
Display harness
Artificial Analysis Stirrup · Cyber Index v1.0 · max
Board
https://artificialanalysis.ai/evaluations/artificial-analysis-cyber-index

Display only. This composite measures defensive source-code tasks. Successful capability scores depend on safety refusals, and refusal rates are reported separately. It does not enter weighted Overall.

Artificial Analysis v1.0, Stirrup. Equal mean of CWE-Bench-AA pass@1, DeepsecBench-AA median F2 over three repeats, and CyberGym-E2E-AA pass@1. DeepsecBench uses a GPT-5.6 Sol High judge. Public-model configurations retain their source effort and fallback labels on the effort and model pages. Trusted-access variants require a distinct catalog identity. Methodology

Compare published benchmark results with category weights →

Models

Results are ordered by score in the display harness, followed by models with no result. Other harnesses are listed separately below. Missing results remain unknown.

26–50 of 469 entries

ModelScoreEvidenceSource-recorded date
c4ai-command-r7b-arabic-02-2025Cohere———
chatglm-6bZ.ai———
chatglm2-6bZ.ai———
chatglm2-6b-32kZ.ai———
chatglm3-6bZ.ai———
chatglm3-6b-128kZ.ai———
chatglm3-6b-32kZ.ai———
Claude Fable 5Anthropic———
Claude Haiku 4.5Anthropic———
Claude Haiku 5.5Anthropic———
Claude Opus 4.5Anthropic———
Claude Opus 4.6Anthropic———
Claude Opus 4.7Anthropic———
Claude Opus 4.8Anthropic———
Claude Opus 5Anthropic———
Claude Sonnet 4.5Anthropic———
Claude Sonnet 4.6Anthropic———
Claude Sonnet 5Anthropic———
Claude Sonnet 5.5Anthropic———
codegeex2-6bZ.ai———
codegeex4-all-9bZ.ai———
CodeGemma 7B ITGoogle———
Codestral 2508Mistral———
cogagent-9b-20241220Z.ai———
cogagent-chat-hfZ.ai———

Other harnesses

These runs use other harnesses. Capability scoring matches configurations separately; model details identify which source records contribute.

ModelScoreHarnessEvidenceSource-recorded date
Gemini 3.8 FlashGoogle25.1449496510851 Artificial Analysis Stirrup · Cyber Index v1.0 · highofficial board2026-10-13
GLM-5.3-FlashZ.ai49.9235527532159 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
Grok 4.7xAI56.432341352642 Artificial Analysis Stirrup · Cyber Index v1.0 · xhighofficial board2026-10-13
MiMo-V2.6-ProXiaomi56.0656020403805 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
MiniMax-M3MiniMax22.3880159084502 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
Mistral Large 4Mistral49.5113823968563 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13
Muse Spark 1.3Meta44.3048343397119 Artificial Analysis Stirrup · Cyber Index v1.0 · xhighofficial board2026-10-13
NVIDIA Nemotron 3 UltraNVIDIA13.0784136433712 Artificial Analysis Stirrup · Cyber Index v1.0 · reasoningofficial board2026-10-13
Qwen3.8-27BQwen12.7243142724314 Artificial Analysis Stirrup · Cyber Index v1.0 · xhighofficial board2026-10-13
Step 5 PreviewStepFun47.7068149907409 Artificial Analysis Stirrup · Cyber Index v1.0 · unspecifiedofficial board2026-10-13