Meta, released Jul 23, 2024

Llama-3.1-70B-Instructprice, context, benchmarks and release details

Provisional: not enough results to rank yet Open weights 93% confidence, 2 of 4 expected sources in

45.7

SI Score

#118 of 142 ranked models

Input, per 1M tokens: not yet reported
Output, per 1M tokens: not yet reported
Context window: 128K
Max output: 4.1K
Released: Jul 23, 2024

How the score breaks down

Coding —

Math 25.7

Preference 57.6

Reasoning 44.2

Weights: reasoning 30%, math 15%, coding 40%, preference 15%. Results use fixed 0–100 scales before averaging, and thin evidence is pulled toward 50. Method si-v3-retained-evidence-2, computed Oct 9, 2026, 05:13 UTC.

Around it on the leaderboard

116 Nemotron 3.5 Lightning 30B A3B 46.1
117 GPT-5 Pro 45.8
118 Llama-3.1-70B-Instruct 45.7
119 Gemini 2.5 Pro 45.2
120 Gemma 3 12B IT 45.1

Full leaderboard

Benchmark results

4 benchmarks, 4 results

Each row shows the best published result. Where a model was tested at several settings, such as reasoning effort, open the row to see each one. Hover or tap a value for its source.

GPQA Diamondreasoning 44.2% 44.2

MATH Level 5math 36.7% 36.7

OTIS Mock AIME 2024–2025math 3.6% 3.6

LMArena Textpreference 1260.9 elo 57.6

Normalization uses a fixed 0–100 scale for each unit, independent of other models. Compare evaluation conditions before reading a small gap as decisive. “Lab-reported” marks the provider's own published figure.

Details and sources

Open weights: Yes
License: not yet reported
Input modalities: text
First seen by SuperIndex: Oct 8, 2026
Coverage: 75% of expected source weight

Reported (2)

Epoch AI BenchmarkingOct 8, 2026
LMArena / ArenaOct 8, 2026

Awaiting (2)

Official model cards via models.dev7% of weight
LiveBench19% of weight

Confidence rises as pending sources publish. Some sources never cover some models, so confidence reaches 100% at 80% of expected weight.