Compare · ModelsLive · 2 picked · head to head
GPT-4o (2024-11-20) vs Qwen2.5 Coder 1.5B Instruct
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GPT-4o (2024-11-20) wins on 2/2 benchmarks
GPT-4o (2024-11-20) wins 2 of 2 shared benchmarks. Leads in coding · knowledge.
Category leads
coding·GPT-4o (2024-11-20)knowledge·GPT-4o (2024-11-20)
Hype vs Reality
Attention vs performance
GPT-4o (2024-11-20)
#156 by perf·no signal
Qwen2.5 Coder 1.5B Instruct
#148 by perf·no signal
Best value
GPT-4o (2024-11-20)
GPT-4o (2024-11-20)
6.0 pts/$
$6.25/M
Qwen2.5 Coder 1.5B Instruct
—
no price
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
2 benchmarks · 2 models
GPT-4o (2024-11-20)Qwen2.5 Coder 1.5B Instruct
Aider · Code Editing
GPT-4o (2024-11-20) leads by +39.8
GPT-4o (2024-11-20)
71.4
Qwen2.5 Coder 1.5B Instruct
31.6
MMLU
GPT-4o (2024-11-20) leads by +40.9
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
GPT-4o (2024-11-20)
79.1
Qwen2.5 Coder 1.5B Instruct
38.1
Full benchmark table
| Benchmark | GPT-4o (2024-11-20) | Qwen2.5 Coder 1.5B Instruct |
|---|---|---|
Aider · Code Editing | 71.4 | 31.6 |
MMLU Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge. | 79.1 | 38.1 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $2.50 | $10.00 | 128K tokens (~64 books) | $43.75 | |
| — | — | — | — |