Alibaba / Qwen, released Nov 12, 2024

Qwen2.5-Coder-32B-Instructprice, context, benchmarks and release details

Provisional: not enough results to rank yet Open weights 90% confidence 90 percent, High confidence, 3 of 5 expected sources in
39.6
SI Score
#127 of 142 ranked models
Input, per 1M tokens
not yet reported
Output, per 1M tokens
not yet reported
Context window
131Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Max output
8.2Kmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
Released
Nov 12, 2024models.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗

How the score breaks down

Coding (weight 40 percent) 19.9
Math (weight 15 percent) —
Preference (weight 15 percent) 53.7
Reasoning (weight 30 percent) —

Weights: reasoning 30%, math 15%, coding 40%, preference 15%. Results use fixed 0–100 scales before averaging, and thin evidence is pulled toward 50. Method si-v3-retained-evidence-2, computed Oct 9, 2026, 06:15 UTC.

Around it on the leaderboard

  1. 125 Claude Haiku 3.5 40.8
  2. 126 Claude Haiku 3 39.9
  3. 127 Qwen2.5-Coder-32B-Instruct 39.6
  4. 128 Gemma 3 4B IT 39.2
  5. 129 GPT-5 Nano 39.1

Full leaderboard

Benchmark results

3 benchmarks, 4 results

Each row shows the best published result. Where a model was tested at several settings, such as reasoning effort, open the row to see each one. Hover or tap a value for its source.

Aider Polyglotcoding 16.4%Aider polyglotPublished source fact [variant] Aider polyglot; 225 cases; 2 attemptsPublished Dec 26, 2024 Retrieved Oct 9, 2026 · Apache-2.0
Open source ↗
16.4
SWE-bench Verifiedcoding 38%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] Skywork-SWE-32BPublished Jun 16, 2025 Retrieved Oct 9, 2026 · factual citation
Open source ↗
38.0 2 settings
  • Setting 1 9%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] mini-SWE-agent; 1.0.0Published Aug 3, 2025 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
  • Setting 2 38%SWE-bench VerifiedSWE-bench published model plus agent result; harness retained, not a base model evaluation [variant] Skywork-SWE-32BPublished Jun 16, 2025 Retrieved Oct 9, 2026 · factual citation
    Open source ↗
About SWE-bench Verified
LMArena Textpreference 1230.0 eloLMArena / ArenaPublished source fact [variant] text / overallPublished Oct 8, 2026 Retrieved Oct 9, 2026 · CC-BY-4.0
Open source ↗
53.7

Normalization uses a fixed 0–100 scale for each unit, independent of other models. Compare evaluation conditions before reading a small gap as decisive. “Lab-reported” marks the provider's own published figure.

Details and sources

Open weights
Yesmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
License
not yet reported
Input modalities
textmodels.devPublished source fact Retrieved Oct 9, 2026 · MIT
Open source ↗
First seen by SuperIndex
Oct 8, 2026
Coverage
72% of expected source weight

Reported (3)

  • Aider polyglotOct 8, 2026
  • LMArena / ArenaOct 8, 2026
  • SWE-bench VerifiedOct 8, 2026

Awaiting (2)

  • Official model cards via models.dev7% of weight
  • LiveBench21% of weight

Confidence rises as pending sources publish. Some sources never cover some models, so confidence reaches 100% at 80% of expected weight.

What changed

All releases · RSS feed

Alerts on this device

What to be alerted about
RSS feed