RankingLlama 3.1 Instruct 70B
Llama 3.1 Instruct 70B
Llama 3.1 Instruct 70B by Meta is a Llama 3.1 model, released 2024-07-23. This profile collects the published benchmark results and reported effort settings for this model. Configurations are compared on the effort page. Ranks are on the leaderboard.
0 published benchmark measures · 10 measured effort results · 0 benchmark families contribute across 0 task areas. 0 capability estimates available in the full profile. See all results ↓ · Compare published benchmarks →
Model evidence summary
This profile combines published settings. It is not a runnable configuration or a leaderboard rank. Compare measured configurations →
Performance profile
Capabilities
Filled points are supported; hollow points are preliminary. Lines stop at unknown capabilities. Exact values and sources follow below.
Scores estimate outcomes against a shared reference panel; they are not accuracy percentages. Sparse or disconnected evidence cannot qualify an overall profile. Open a capability to inspect its evidence.
Reported effort · No results
Settings reported in this model's published benchmark results, including results outside the aggregate. Effort names are provider-specific. These are not API defaults or equal compute budgets.
No benchmark results available.
Mixed settings means multiple settings occur in the evidence. Best across efforts means the source selected its best reported result across settings; it does not mean Max. Unspecified settings stay unknown. This model-summary chart combines reported settings. The leaderboard keeps identified configurations separate and excludes unknown effort.
Inspect each result and its source ↓ · Download effort evidenceScore contributions and missing evidence
0 contributing families across 0 capabilities. Fixed reference panels do not change when the catalog expands.
Capability is fitted jointly across families. Capability estimates below describe different task areas; their weighted sum is not the Capability score.
Results without reviewed compatibility or a reference match remain in the raw evidence below. Coverage counts only contributing results.
Model information & shareable badge
- Lab
- Meta
- Family
- Llama 3.1
- Released
- 2024-07-23
- Context
- —
- License
- —
- Model card
- https://artificialanalysis.ai/models/llama-3-1-instruct-70b
- Default Capability family coverage
/badge/llama-3-1-instruct-70b.svg
Llama 3.1 Instruct 70B measured results by effort setting
Each row is one published result for one effort setting. Evidence collected 2026-11-22. Compare the effort settings →
| Benchmark | Effort | Score | Source |
|---|---|---|---|
| AIME 2025 | Non-reasoning | 4.0% | Artificial Analysis |
| CritPt | Non-reasoning | 0.0% | Artificial Analysis |
| GPQA Diamond | Non-reasoning | 40.9% | Artificial Analysis |
| Humanity's Last Exam | Non-reasoning | 4.5% | Artificial Analysis |
| IFBench | Non-reasoning | 34.4% | Artificial Analysis |
| LiveCodeBench | Non-reasoning | 23.2% | Artificial Analysis |
| MATH-500 | Non-reasoning | 64.9% | Artificial Analysis |
| MMLU-Pro | Non-reasoning | 67.6% | Artificial Analysis |
| Terminal-Bench Hard | Non-reasoning | 3.0% | Artificial Analysis |
| 𝜏²-Bench Telecom | Non-reasoning | 15.2% | Artificial Analysis |
Benchmark scores & sources
Original results, evaluation harnesses, and evidence behind this model.
| Benchmark | Bucket | Score | Harness | Evidence | Source-recorded date |
|---|---|---|---|---|---|
| ARC-AGI-2 | Hard reasoning | — | — | — | — |
| DeepSWE v1.1 | Agentic | — | — | — | — |
| GDPval-AA | Agentic | — | — | — | — |
| GPQA Diamond | Hard reasoning | — | — | — | — |
| Humanity's Last Exam | Hard reasoning | — | — | — | — |
| LiveCodeBench | Coding | — | — | — | — |
| LMArena Text Arena | Human pref | — | — | — | — |
| MMLU-Pro | Knowledge | — | — | — | — |
| OSWorld-Verified | Agentic | — | — | — | — |
| SWE-bench Pro | Agentic | — | — | — | — |
| SWE-bench Verified | Agentic | — | — | — | — |
| Terminal-Bench 2.1 | Agentic | — | — | — | — |