RankingIMOAnswerBench (no tools) · source release snapshot; version not specified
IMOAnswerBench (no tools) · source release snapshot; version not specified
- Bucket
- Hard reasoning
- Unit
- percent
- Direction
- Higher is better
- Version
- source release snapshot; version not specified
- Display harness
- nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
- Board
- https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16
Compare published benchmark results with category weights →
Models
| Model | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|
| Kimi-K2.6Moonshot | 91.1%Reported settings & sourceNVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol. First-party reported result. Original cell: 91.1 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (no tools) · reviewed 2026-09-06 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | lab self-report | 2026-09-06 |
| NVIDIA Nemotron 3 UltraNVIDIA | 88.6%Reported settings & sourceNVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol. First-party reported result. Original cell: 88.6 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (no tools) · reviewed 2026-09-06 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | lab self-report | 2026-09-06 |
| GLM-5.1Z.ai | 86.8%Reported settings & sourceNVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol. First-party reported result. Original cell: 86.8 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (no tools) · reviewed 2026-09-06 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | lab self-report | 2026-09-06 |
| Qwen3.5-397B-A17BQwen | 83.1%Reported settings & sourceNVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol. First-party reported result. Original cell: 83.1 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (no tools) · reviewed 2026-09-06 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | lab self-report | 2026-09-06 |
| MiniMax-M2.7MiniMax | 68.3%Reported settings & sourceNVIDIA evaluation harness/settings per benchmark in model card; comparator scores are NVIDIA-reported under that protocol. First-party reported result. Original cell: 68.3 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Performance table: IMOAnswerBench (no tools) · reviewed 2026-09-06 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | lab self-report | 2026-09-06 |