Compare published benchmarks

Use the full performance tables published with model releases. Compare the tests both models have, with category weights you choose.

These are publisher-reported configurations. A shared table does not establish equal inference budgets or an independent reproduction. Win share measures the fraction of weighted test outcomes won, not the size or statistical significance of an advantage.

Category weights

Weights are relative. Categories share the total; each benchmark family shares its category equally. Related versions and settings divide their family’s allocation.

Select two different models and a published evaluation.

Explore all benchmark coverage · Compare the calibrated benchmark set · Download all observations