Anthropic, released May 22, 2025

Claude Opus 4price, context, benchmarks and release details

Provisional: not enough results to rank yet 100% confidence 100 percent, Full confidence, 6 of 9 expected sources in
55.5
SI Score
#87 of 142 ranked models
Input, per 1M tokens
$15.00Anthropic API pricingOfficial Claude API base tokens; lowest short-context global Standard rate; cache, batch, fast and regional premiums excluded Retrieved Oct 9, 2026 · factual citation
Open source ↗
Output, per 1M tokens
$75.00Anthropic API pricingOfficial Claude API base tokens; lowest short-context global Standard rate; cache, batch, fast and regional premiums excluded Retrieved Oct 9, 2026 · factual citation
Open source ↗
Context window
200Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Max output
32Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Released
May 22, 2025models.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗

How the score breaks down

Coding (weight 40 percent) 70.6
Math (weight 15 percent) 75.2
Preference (weight 15 percent) 69.6
Reasoning (weight 30 percent) 22.9

Weights: reasoning 30%, math 15%, coding 40%, preference 15%. Results use fixed 0–100 scales before averaging, and thin evidence is pulled toward 50. Method si-v3-retained-evidence-2, computed Oct 9, 2026, 06:15 UTC.

Around it on the leaderboard

  1. 85 GPT-5.1 55.7
  2. 86 Qwen3.6 27B 55.6
  3. 87 Claude Opus 4 55.5
  4. 88 o3 55.4
  5. 89 Gemini 3.5 Flash Lite 55.2

Full leaderboard

Benchmark results

11 benchmarks, 28 results

Each row shows the best published result. Where a model was tested at several settings, such as reasoning effort, open the row to see each one. Hover or tap a value for its source.

ARC-AGI-1 (public eval)reasoning 54.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 54.3 4 settings
  • Setting 1 35.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 2 54.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 3 43.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 4 45.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
About ARC-AGI-1 (public eval)
ARC-AGI-1 (semi-private)reasoning 35.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 35.7 4 settings
  • Setting 1 22.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 2 35.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 3 27%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 4 30.7%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
About ARC-AGI-1 (semi-private)
ARC-AGI-2 (public eval)reasoning 3.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 3.3 4 settings
  • Setting 1 1.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 2 3.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 3 0.4%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 4 2.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
About ARC-AGI-2 (public eval)
ARC-AGI-2 (semi-private)reasoning 8.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 8.6 4 settings
  • Setting 1 1.3%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514Published Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 2 8.6%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-16kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 3 0%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-1kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 4 4.5%ARC PrizeARC Prize steward-published result; exact edition/subset; publication time is HTTP Last-Modified of the aggregate export, not the evaluation date. [variant] claude-opus-4-20250514-thinking-8kPublished Oct 6, 2026 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
About ARC-AGI-2 (semi-private)
GPQA Diamondreasoning 76.3%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 16KPublished May 22, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 76.3 2 settings
  • 16K thinking 76.3%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 16KPublished May 22, 2025 Retrieved Oct 9, 2026 · CC-BY
    Open source ↗
  • Setting 2 69.2%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published May 22, 2025 Retrieved Oct 9, 2026 · CC-BY
    Open source ↗
About GPQA Diamond
Humanity's Last Exam (Scale AI)reasoning 10.7%Humanity’s Last ExamPotential contamination warning: This model was evaluated after the public release of HLE, allowing model builder access to the prompts and solutions. [variant] Published May 24, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 10.7
MATH Level 5math 85.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published May 22, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 85.0
OTIS Mock AIME 2024–2025math 64.4%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 27KPublished May 28, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗ 64.4 3 settings
  • 16K thinking 60%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 16KPublished May 22, 2025 Retrieved Oct 9, 2026 · CC-BY
    Open source ↗
  • 27K thinking 64.4%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] 27KPublished May 28, 2025 Retrieved Oct 9, 2026 · CC-BY
    Open source ↗
  • Setting 3 42.2%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published May 22, 2025 Retrieved Oct 9, 2026 · CC-BY
    Open source ↗
About OTIS Mock AIME 2024–2025
Aider Polyglotcoding 70.7%Aider polyglotPublished source fact [variant] Aider polyglot; 225 cases; 2 attemptsPublished May 25, 2025 Retrieved Oct 9, 2026 · Apache-2.0
Open source ↗ 70.7
SWE-bench Verifiedcoding 73.2%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] ToolsPublished May 22, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗ 73.2 3 settings
  • Setting 1 70.7%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 6, 2026 Retrieved Oct 9, 2026 · CC-BY
    Open source ↗
  • Setting 2 67.6%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] mini-SWE-agent; 1.0.0Published Aug 2, 2025 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 3 73.2%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] ToolsPublished May 22, 2025 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
About SWE-bench Verified
LMArena Textpreference 1365.8 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 8, 2026 Retrieved Oct 9, 2026 · CC-BY-4.0
Open source ↗ 69.6

Normalization uses a fixed 0–100 scale for each unit, independent of other models. Compare evaluation conditions before reading a small gap as decisive. “Lab-reported” marks the provider's own published figure.

Details and sources

Open weights
Nomodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
License
not yet reported
Input modalities
text, image, pdfmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
First seen by SuperIndex
Oct 8, 2026
Coverage
80% of expected source weight

Reported (6)

  • Aider polyglotOct 8, 2026
  • ARC PrizeOct 8, 2026
  • Epoch AI BenchmarkingOct 8, 2026
  • Humanity’s Last ExamOct 8, 2026
  • LMArena / ArenaOct 8, 2026
  • SWE-bench VerifiedOct 8, 2026

Awaiting (3)

  • Official model cards via models.dev4% of weight
  • LiveBench11% of weight
  • Terminal-Bench5% of weight

Confidence rises as pending sources publish. Some sources never cover some models, so confidence reaches 100% at 80% of expected weight.

What changed

All releases · RSS feed

Alerts on this device

What to be alerted about
RSS feed