RankingLongbench v2 (≤ 1M) · source release snapshot; version not specified

Longbench v2 (≤ 1M) · source release snapshot; version not specified

Data updated 12 Sept 2026

Bucket
Long context
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
Board
https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
Qwen3.5-397B-A17BQwen68.9%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 68.9

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Longbench v2 (≤ 1M) · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06
NVIDIA Nemotron 3 UltraNVIDIA61.9%
Reported settings & source

NVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol.

First-party reported result. Original cell: 61.9

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: Longbench v2 (≤ 1M) · reviewed 2026-09-06

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16lab self-report2026-09-06