Compare · ModelsLive · 2 picked · head to head
Gemma 2B vs LLaMA-13B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
LLaMA-13B wins on 10/15 benchmarks
LLaMA-13B wins 10 of 15 shared benchmarks. Leads in knowledge · reasoning · math.
Category leads
knowledge·LLaMA-13Breasoning·LLaMA-13Bmath·LLaMA-13Bgeneral·LLaMA-13Blanguage·Gemma 2B
Hype vs Reality
Attention vs performance
Gemma 2B
#189 by perf·no signal
LLaMA-13B
#170 by perf·no signal
Vendor risk
Who is behind the model
Google DeepMind
$4.00T·Tier 1
Meta AI
$1.50T·Tier 1
Head to head
15 benchmarks · 2 models
Gemma 2BLLaMA-13B
ARC AI2
LLaMA-13B leads by +14.1
AI2 Reasoning Challenge · tests grade-school level science knowledge with multiple-choice questions requiring reasoning beyond simple retrieval.
Gemma 2B
22.8
LLaMA-13B
36.9
BBH
LLaMA-13B leads by +3.6
BIG-Bench Hard · a curated subset of 23 challenging tasks from BIG-Bench where language models previously failed to outperform average humans.
Gemma 2B
13.6
LLaMA-13B
17.2
GSM8K
LLaMA-13B leads by +2.9
Grade School Math 8K · 8,500 linguistically diverse grade-school math word problems that require multi-step reasoning to solve.
Gemma 2B
17.7
LLaMA-13B
20.6
HellaSwag
LLaMA-13B leads by +10.4
HellaSwag · tests commonsense reasoning by asking models to predict the most plausible continuation of everyday scenarios.
Gemma 2B
61.9
LLaMA-13B
72.3
BBH (HuggingFace)
LLaMA-13B leads by +4.1
Gemma 2B
21.1
LLaMA-13B
25.3
GPQA
Gemma 2B leads by +1.4
Gemma 2B
4.9
LLaMA-13B
3.5
IFEval
Gemma 2B leads by +1.3
Gemma 2B
26.6
LLaMA-13B
25.3
MATH Level 5
Gemma 2B leads by +4.3
Gemma 2B
7.4
LLaMA-13B
3.1
MMLU-PRO
LLaMA-13B leads by +1.4
Gemma 2B
21.6
LLaMA-13B
23.1
MUSR
Gemma 2B leads by +9.0
Gemma 2B
11.0
LLaMA-13B
2.0
MMLU
LLaMA-13B leads by +7.2
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
Gemma 2B
23.1
LLaMA-13B
30.3
OpenBookQA
Gemma 2B leads by +29.6
OpenBookQA · science questions that require combining a given core fact with broad common knowledge, mimicking an open-book exam setting.
Gemma 2B
71.5
LLaMA-13B
41.9
PIQA
LLaMA-13B leads by +5.6
PIQA (Physical Interaction QA) · tests intuitive physical reasoning by asking models to select the correct approach for everyday physical tasks.
Gemma 2B
54.6
LLaMA-13B
60.2
TriviaQA
LLaMA-13B leads by +24.7
TriviaQA · reading comprehension benchmark with trivia questions, requiring models to find and reason over evidence from provided documents.
Gemma 2B
53.2
LLaMA-13B
77.9
Winogrande
LLaMA-13B leads by +15.2
WinoGrande · large-scale commonsense reasoning benchmark where models must resolve ambiguous pronouns in carefully constructed sentence pairs.
Gemma 2B
30.8
LLaMA-13B
46.0
Full benchmark table
| Benchmark | Gemma 2B | LLaMA-13B |
|---|---|---|
ARC AI2 AI2 Reasoning Challenge · tests grade-school level science knowledge with multiple-choice questions requiring reasoning beyond simple retrieval. | 22.8 | 36.9 |
BBH BIG-Bench Hard · a curated subset of 23 challenging tasks from BIG-Bench where language models previously failed to outperform average humans. | 13.6 | 17.2 |
GSM8K Grade School Math 8K · 8,500 linguistically diverse grade-school math word problems that require multi-step reasoning to solve. | 17.7 | 20.6 |
HellaSwag HellaSwag · tests commonsense reasoning by asking models to predict the most plausible continuation of everyday scenarios. | 61.9 | 72.3 |
BBH (HuggingFace) | 21.1 | 25.3 |
GPQA | 4.9 | 3.5 |
IFEval | 26.6 | 25.3 |
MATH Level 5 | 7.4 | 3.1 |
MMLU-PRO | 21.6 | 23.1 |
MUSR | 11.0 | 2.0 |
MMLU Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge. | 23.1 | 30.3 |
OpenBookQA OpenBookQA · science questions that require combining a given core fact with broad common knowledge, mimicking an open-book exam setting. | 71.5 | 41.9 |
PIQA PIQA (Physical Interaction QA) · tests intuitive physical reasoning by asking models to select the correct approach for everyday physical tasks. | 54.6 | 60.2 |
TriviaQA TriviaQA · reading comprehension benchmark with trivia questions, requiring models to find and reason over evidence from provided documents. | 53.2 | 77.9 |
Winogrande WinoGrande · large-scale commonsense reasoning benchmark where models must resolve ambiguous pronouns in carefully constructed sentence pairs. | 30.8 | 46.0 |
Pricing · per 1M tokens · projected $/mo at 10M tokens