Compare · ModelsLive · 2 picked · head to head
Gpt2 Medium vs Distilgpt2
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Gpt2 Medium wins on 3/6 benchmarks
Gpt2 Medium wins 3 of 6 shared benchmarks. Leads in knowledge · language · math.
Category leads
general·Distilgpt2knowledge·Gpt2 Mediumlanguage·Gpt2 Mediummath·Gpt2 Mediumreasoning·Distilgpt2
Hype vs Reality
Attention vs performance
Gpt2 Medium
#234 by perf·no signal
Distilgpt2
#239 by perf·no signal
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
D
DistilBERT
private · undisclosed
Head to head
6 benchmarks · 2 models
Gpt2 MediumDistilgpt2
BBH (HuggingFace)
Distilgpt2 leads by +0.1
Gpt2 Medium
2.7
Distilgpt2
2.8
GPQA
Gpt2 Medium leads by +0.4
Gpt2 Medium
1.7
Distilgpt2
1.2
IFEval
Gpt2 Medium leads by +16.0
Gpt2 Medium
22.1
Distilgpt2
6.1
MATH Level 5
Gpt2 Medium leads by +0.2
Gpt2 Medium
0.8
Distilgpt2
0.6
MMLU-PRO
Distilgpt2 leads by +0.1
Gpt2 Medium
2.0
Distilgpt2
2.1
MUSR
Distilgpt2 leads by +5.0
Gpt2 Medium
6.2
Distilgpt2
11.2
Full benchmark table
| Benchmark | Gpt2 Medium | Distilgpt2 |
|---|---|---|
BBH (HuggingFace) | 2.7 | 2.8 |
GPQA | 1.7 | 1.2 |
IFEval | 22.1 | 6.1 |
MATH Level 5 | 0.8 | 0.6 |
MMLU-PRO | 2.0 | 2.1 |
MUSR | 6.2 | 11.2 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| Gpt2 Medium | — | — | — | — |
D Distilgpt2 | — | — | — | — |