OpenAI, released May 13, 2024

GPT-4o (2024-05-13)price, context, benchmarks and release details

Provisional: not enough results to rank yet 93% confidence 93 percent, High confidence, 2 of 4 expected sources in
49.4
SI Score
#109 of 142 ranked models
Input, per 1M tokens
$5.00LiteLLMFirst-party API Standard token rate; MIT LiteLLM transcription. Provider documentation: https://developers.openai.com/api/docs/pricing. Exact endpoint only; cache/batch/long-context rates excluded Retrieved Oct 9, 2026 · MIT
Open source ↗
Output, per 1M tokens
$15.00LiteLLMFirst-party API Standard token rate; MIT LiteLLM transcription. Provider documentation: https://developers.openai.com/api/docs/pricing. Exact endpoint only; cache/batch/long-context rates excluded Retrieved Oct 9, 2026 · MIT
Open source ↗
Context window
128Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Max output
4.1Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Released
May 13, 2024models.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗

How the score breaks down

Coding (weight 40 percent) —
Math (weight 15 percent) 36.1
Preference (weight 15 percent) 62.3
Reasoning (weight 30 percent) 48.9

Weights: reasoning 30%, math 15%, coding 40%, preference 15%. Results use fixed 0–100 scales before averaging, and thin evidence is pulled toward 50. Method si-v3-retained-evidence-2, computed Oct 9, 2026, 05:13 UTC.

Around it on the leaderboard

  1. 107 Qwen3 235B-A22B 50.3
  2. 108 Qwen3 Max 50.2
  3. 109 GPT-4o (2024-05-13) 49.4
  4. 110 Claude Sonnet 3.7 48.9
  5. 111 Mistral Small 3.1 24B 48.4

Full leaderboard

Benchmark results

4 benchmarks, 4 results

Each row shows the best published result. Where a model was tested at several settings, such as reasoning effort, open the row to see each one. Hover or tap a value for its source.

GPQA Diamondreasoning 48.9%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Jan 27, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗
48.9
MATH Level 5math 51.0%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Jan 27, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗
51.0
OTIS Mock AIME 2024–2025math 6.3%Epoch AI BenchmarkingEpoch-owned evaluation mean score; scores only, no benchmark questions [variant] Published Feb 25, 2025 Retrieved Oct 9, 2026 · CC-BY
Open source ↗
6.3
LMArena Textpreference 1300.4 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 8, 2026 Retrieved Oct 9, 2026 · CC-BY-4.0
Open source ↗
62.3

Normalization uses a fixed 0–100 scale for each unit, independent of other models. Compare evaluation conditions before reading a small gap as decisive. “Lab-reported” marks the provider's own published figure.

Details and sources

Open weights
Nomodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
License
not yet reported
Input modalities
text, imagemodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
First seen by SuperIndex
Oct 8, 2026
Coverage
75% of expected source weight

Reported (2)

  • Epoch AI BenchmarkingOct 8, 2026
  • LMArena / ArenaOct 8, 2026

Awaiting (2)

  • Official model cards via models.dev7% of weight
  • LiveBench19% of weight

Confidence rises as pending sources publish. Some sources never cover some models, so confidence reaches 100% at 80% of expected weight.

What changed

All releases · RSS feed

Alerts on this device

What to be alerted about
RSS feed