Compare · ModelsLive · 2 picked · head to head
Gemma 2 27B vs Phi 3.5 Mini Instruct
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Gemma 2 27B wins on 5/6 benchmarks
Gemma 2 27B wins 5 of 6 shared benchmarks. Leads in general · knowledge · language.
Category leads
general·Gemma 2 27Bknowledge·Gemma 2 27Blanguage·Gemma 2 27Bmath·Gemma 2 27Breasoning·Phi 3.5 Mini Instruct
Hype vs Reality
Attention vs performance
Gemma 2 27B
#177 by perf·no signal
Phi 3.5 Mini Instruct
#194 by perf·no signal
Vendor risk
Who is behind the model
Google DeepMind
$4.00T·Tier 1
Microsoft
$3.00T·Big Tech
Head to head
6 benchmarks · 2 models
Gemma 2 27BPhi 3.5 Mini Instruct
BBH (HuggingFace)
Gemma 2 27B leads by +12.5
Gemma 2 27B
49.3
Phi 3.5 Mini Instruct
36.8
GPQA
Gemma 2 27B leads by +4.7
Gemma 2 27B
16.7
Phi 3.5 Mini Instruct
12.0
IFEval
Gemma 2 27B leads by +22.0
Gemma 2 27B
79.8
Phi 3.5 Mini Instruct
57.8
MATH Level 5
Gemma 2 27B leads by +4.2
Gemma 2 27B
23.9
Phi 3.5 Mini Instruct
19.6
MMLU-PRO
Gemma 2 27B leads by +5.4
Gemma 2 27B
38.4
Phi 3.5 Mini Instruct
32.9
MUSR
Phi 3.5 Mini Instruct leads by +1.0
Gemma 2 27B
9.1
Phi 3.5 Mini Instruct
10.1
Full benchmark table
| Benchmark | Gemma 2 27B | Phi 3.5 Mini Instruct |
|---|---|---|
BBH (HuggingFace) | 49.3 | 36.8 |
GPQA | 16.7 | 12.0 |
IFEval | 79.8 | 57.8 |
MATH Level 5 | 23.9 | 19.6 |
MMLU-PRO | 38.4 | 32.9 |
MUSR | 9.1 | 10.1 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.65 | $0.65 | 8K tokens (~4 books) | $6.50 | |
| — | — | — | — |