Anthropic, released Oct 22, 2024

Claude Haiku 3.5price, context, benchmarks and release details

Provisional: not enough results to rank yet 100% confidence, 4 of 6 expected sources in

40.8

SI Score

#125 of 142 ranked models

Input, per 1M tokens: $0.80
Output, per 1M tokens: $4.00
Context window: 200K
Max output: 8.2K
Released: Oct 22, 2024

How the score breaks down

Coding 34.3

Math 32.3

Preference 56.9

Reasoning 38.1

Weights: reasoning 30%, math 15%, coding 40%, preference 15%. Results use fixed 0–100 scales before averaging, and thin evidence is pulled toward 50. Method si-v3-retained-evidence-2, computed Oct 9, 2026, 05:13 UTC.

Around it on the leaderboard

123 o3-mini 41.6
124 GPT-4.1 41.5
125 Claude Haiku 3.5 40.8
126 Claude Haiku 3 39.9
127 Qwen2.5-Coder-32B-Instruct 39.6

Full leaderboard

Benchmark results

6 benchmarks, 6 results

Each row shows the best published result. Where a model was tested at several settings, such as reasoning effort, open the row to see each one. Hover or tap a value for its source.

GPQA Diamondreasoning 38.1% 38.1

MATH Level 5math 46.4% 46.4

OTIS Mock AIME 2024–2025math 4.3% 4.3

Aider Polyglotcoding 28% 28.0

SWE-bench Verifiedcoding 40.6% 40.6

LMArena Textpreference 1255.4 elo 56.9

Normalization uses a fixed 0–100 scale for each unit, independent of other models. Compare evaluation conditions before reading a small gap as decisive. “Lab-reported” marks the provider's own published figure.

Details and sources

Open weights: No
License: not yet reported
Input modalities: text, image, pdf
First seen by SuperIndex: Oct 8, 2026
Coverage: 80% of expected source weight

Reported (4)

Aider polyglotOct 8, 2026
Epoch AI BenchmarkingOct 8, 2026
LMArena / ArenaOct 8, 2026
SWE-bench VerifiedOct 8, 2026

Awaiting (2)

Official model cards via models.dev5% of weight
LiveBench15% of weight

Confidence rises as pending sources publish. Some sources never cover some models, so confidence reaches 100% at 80% of expected weight.