Compare · ModelsLive · 2 picked · head to head
GPT-4 Turbo (batch) vs Qwen2.5 Coder 32B Instruct
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GPT-4 Turbo (batch) wins on 3/4 benchmarks
GPT-4 Turbo (batch) wins 3 of 4 shared benchmarks. Leads in knowledge.
Category leads
math·Qwen2.5 Coder 32B Instructknowledge·GPT-4 Turbo (batch)
Hype vs Reality
Attention vs performance
GPT-4 Turbo (batch)
#190 by perf·no signal
Qwen2.5 Coder 32B Instruct
#107 by perf·#1 by attention
Best value
Qwen2.5 Coder 32B Instruct
15.3x better value than GPT-4 Turbo (batch)
GPT-4 Turbo (batch)
4.2 pts/$
$10.00/M
Qwen2.5 Coder 32B Instruct
64.0 pts/$
$0.83/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
4 benchmarks · 2 models
GPT-4 Turbo (batch)Qwen2.5 Coder 32B Instruct
GSM8K
Qwen2.5 Coder 32B Instruct leads by +1.1
Grade School Math 8K · 8,500 linguistically diverse grade-school math word problems that require multi-step reasoning to solve.
GPT-4 Turbo (batch)
90.0
Qwen2.5 Coder 32B Instruct
91.1
HellaSwag
GPT-4 Turbo (batch) leads by +16.4
HellaSwag · tests commonsense reasoning by asking models to predict the most plausible continuation of everyday scenarios.
GPT-4 Turbo (batch)
93.7
Qwen2.5 Coder 32B Instruct
77.3
MMLU
GPT-4 Turbo (batch) leads by +4.4
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
GPT-4 Turbo (batch)
76.5
Qwen2.5 Coder 32B Instruct
72.1
Winogrande
GPT-4 Turbo (batch) leads by +13.4
WinoGrande · large-scale commonsense reasoning benchmark where models must resolve ambiguous pronouns in carefully constructed sentence pairs.
GPT-4 Turbo (batch)
75.0
Qwen2.5 Coder 32B Instruct
61.6
Full benchmark table
| Benchmark | GPT-4 Turbo (batch) | Qwen2.5 Coder 32B Instruct |
|---|---|---|
GSM8K Grade School Math 8K · 8,500 linguistically diverse grade-school math word problems that require multi-step reasoning to solve. | 90.0 | 91.1 |
HellaSwag HellaSwag · tests commonsense reasoning by asking models to predict the most plausible continuation of everyday scenarios. | 93.7 | 77.3 |
MMLU Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge. | 76.5 | 72.1 |
Winogrande WinoGrande · large-scale commonsense reasoning benchmark where models must resolve ambiguous pronouns in carefully constructed sentence pairs. | 75.0 | 61.6 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $5.00 | $15.00 | 128K tokens (~64 books) | $75.00 | |
| $0.66 | $1.00 | 33K tokens (~16 books) | $7.45 |
People also compared