Compare · ModelsLive · 2 picked · head to head
Qwen2.5 7B Instruct vs Gemma 2 27B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Gemma 2 27B wins on 5/6 benchmarks
Gemma 2 27B wins 5 of 6 shared benchmarks. Leads in general · knowledge · language.
Category leads
general·Gemma 2 27Bknowledge·Gemma 2 27Blanguage·Gemma 2 27Bmath·Qwen2.5 7B Instructreasoning·Gemma 2 27B
Hype vs Reality
Attention vs performance
Qwen2.5 7B Instruct
#169 by perf·no signal
Gemma 2 27B
#177 by perf·no signal
Best value
Qwen2.5 7B Instruct
9.9x better value than Gemma 2 27B
Qwen2.5 7B Instruct
502.9 pts/$
$0.07/M
Gemma 2 27B
50.6 pts/$
$0.65/M
Vendor risk
Who is behind the model
Alibaba (Qwen)
$293.0B·Tier 1
Google DeepMind
$4.00T·Tier 1
Head to head
6 benchmarks · 2 models
Qwen2.5 7B InstructGemma 2 27B
BBH (HuggingFace)
Gemma 2 27B leads by +14.4
Qwen2.5 7B Instruct
34.9
Gemma 2 27B
49.3
GPQA
Gemma 2 27B leads by +11.2
Qwen2.5 7B Instruct
5.5
Gemma 2 27B
16.7
IFEval
Gemma 2 27B leads by +3.9
Qwen2.5 7B Instruct
75.8
Gemma 2 27B
79.8
MATH Level 5
Qwen2.5 7B Instruct leads by +26.1
Qwen2.5 7B Instruct
50.0
Gemma 2 27B
23.9
MMLU-PRO
Gemma 2 27B leads by +1.8
Qwen2.5 7B Instruct
36.5
Gemma 2 27B
38.4
MUSR
Gemma 2 27B leads by +0.7
Qwen2.5 7B Instruct
8.4
Gemma 2 27B
9.1
Full benchmark table
| Benchmark | Qwen2.5 7B Instruct | Gemma 2 27B |
|---|---|---|
BBH (HuggingFace) | 34.9 | 49.3 |
GPQA | 5.5 | 16.7 |
IFEval | 75.8 | 79.8 |
MATH Level 5 | 50.0 | 23.9 |
MMLU-PRO | 36.5 | 38.4 |
MUSR | 8.4 | 9.1 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.04 | $0.10 | 33K tokens (~16 books) | $0.55 | |
| $0.65 | $0.65 | 8K tokens (~4 books) | $6.50 |