Beta
Compare · ModelsLive · 2 picked · head to head

Qwen2.5 Coder 1.5B Instruct vs GPT-4o (2024-11-20)

Side by side · benchmarks, pricing, and signals you can act on.

Winner summary

GPT-4o (2024-11-20) wins 2 of 2 shared benchmarks. Leads in coding · knowledge.

Category leads
coding·GPT-4o (2024-11-20)knowledge·GPT-4o (2024-11-20)
Hype vs Reality
Qwen2.5 Coder 1.5B Instruct
#146 by perf·no signal
QUIET
GPT-4o (2024-11-20)
#154 by perf·no signal
QUIET
Best value
Qwen2.5 Coder 1.5B Instruct
no price
GPT-4o (2024-11-20)
6.0 pts/$
$6.25/M
Vendor risk
Alibaba logo
Alibaba (Qwen)
$293.0B·Tier 1
Low risk
OpenAI logo
OpenAI
$840.0B·Tier 1
Medium risk
Head to head
Qwen2.5 Coder 1.5B InstructGPT-4o (2024-11-20)
Aider · Code Editing
GPT-4o (2024-11-20) leads by +39.8
Qwen2.5 Coder 1.5B Instruct
31.6
GPT-4o (2024-11-20)
71.4
MMLU
GPT-4o (2024-11-20) leads by +40.9
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
Qwen2.5 Coder 1.5B Instruct
38.1
GPT-4o (2024-11-20)
79.1
Full benchmark table
BenchmarkQwen2.5 Coder 1.5B InstructGPT-4o (2024-11-20)
Aider · Code Editing
31.671.4
MMLU
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
38.179.1
Pricing · per 1M tokens · projected $/mo at 10M tokens
ModelInputOutputContextProjected $/mo
Alibaba logoQwen2.5 Coder 1.5B Instruct
OpenAI logoGPT-4o (2024-11-20)$2.50$10.00128K tokens (~64 books)$43.75