RankingBFCL v4 · source release snapshot; version not specified

BFCL v4 · source release snapshot; version not specified

Data updated 12 Sept 2026

Bucket
Agentic
Unit
percent
Direction
Higher is better
Version
source release snapshot; version not specified
Display harness
Amazon Nova 2 technical report
Board
https://cdn.amazon.science/c5/3d/84514a224666b5be6de4b43ef4aa/nova-2-0-technical-report2.pdf

Compare published benchmark results with category weights →

Models

ModelScoreHarnessEvidenceSource-recorded date
Claude Sonnet 4.5Anthropic68.7%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Claude Haiku 4.5Anthropic61.8%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Amazon Nova 2 Pro PreviewAmazon61.6%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
GPT-5OpenAI61.6%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Amazon Nova 2 LiteAmazon60.3%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
GPT-5.1OpenAI60.1%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
GPT-5 MiniOpenAI56%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Gemini 2.5 FlashGoogle55.9%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Amazon Nova PremierAmazon53.9%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Gemini 2.5 ProGoogle52.3%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Amazon Nova ProAmazon38%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06
Amazon Nova LiteAmazon33.2%
Reported settings & source

Nova2 launch evaluation; benchmark-specific settings in report. tau2 Verified avg@3; telecom cited AA because user model sensitivity; comparators mix own runs and cited provider scores.

First-party reported result; comparator results retain the source evaluation setup.

Amazon Nova 2 technical report · Table2 · reviewed 2026-09-06

Amazon Nova 2 technical reportlab self-report2026-09-06