Compare · ModelsLive · 2 picked · head to head
GPT-4o-mini (2024-07-18) vs Qwen2.5 Coder 32B Instruct
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GPT-4o-mini (2024-07-18) wins on 3/4 benchmarks
GPT-4o-mini (2024-07-18) wins 3 of 4 shared benchmarks. Leads in arena · math · knowledge.
Category leads
coding·Qwen2.5 Coder 32B Instructarena·GPT-4o-mini (2024-07-18)math·GPT-4o-mini (2024-07-18)knowledge·GPT-4o-mini (2024-07-18)
Hype vs Reality
Attention vs performance
GPT-4o-mini (2024-07-18)
#125 by perf·no signal
Qwen2.5 Coder 32B Instruct
#83 by perf·no signal
Best value
GPT-4o-mini (2024-07-18)
1.8x better value than Qwen2.5 Coder 32B Instruct
GPT-4o-mini (2024-07-18)
115.2 pts/$
$0.38/M
Qwen2.5 Coder 32B Instruct
64.0 pts/$
$0.83/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
4 benchmarks · 2 models
GPT-4o-mini (2024-07-18)Qwen2.5 Coder 32B Instruct
Aider polyglot
Qwen2.5 Coder 32B Instruct leads by +12.8
Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework.
GPT-4o-mini (2024-07-18)
3.6
Qwen2.5 Coder 32B Instruct
16.4
Chatbot Arena Elo · Overall
GPT-4o-mini (2024-07-18) leads by +47.3
GPT-4o-mini (2024-07-18)
1317.2
Qwen2.5 Coder 32B Instruct
1269.9
GSM8K
GPT-4o-mini (2024-07-18) leads by +0.2
Grade School Math 8K · 8,500 linguistically diverse grade-school math word problems that require multi-step reasoning to solve.
GPT-4o-mini (2024-07-18)
91.3
Qwen2.5 Coder 32B Instruct
91.1
MMLU
GPT-4o-mini (2024-07-18) leads by +3.6
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
GPT-4o-mini (2024-07-18)
75.7
Qwen2.5 Coder 32B Instruct
72.1
Full benchmark table
| Benchmark | GPT-4o-mini (2024-07-18) | Qwen2.5 Coder 32B Instruct |
|---|---|---|
Aider polyglot Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework. | 3.6 | 16.4 |
Chatbot Arena Elo · Overall | 1317.2 | 1269.9 |
GSM8K Grade School Math 8K · 8,500 linguistically diverse grade-school math word problems that require multi-step reasoning to solve. | 91.3 | 91.1 |
MMLU Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge. | 75.7 | 72.1 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.15 | $0.60 | 128K tokens (~64 books) | $2.62 | |
| $0.66 | $1.00 | 33K tokens (~16 books) | $7.45 |
People also compared