Compare · ModelsLive · 2 picked · head to head
Gpt Neo 125m vs SmolLM2 135M Instruct
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
SmolLM2 135M Instruct wins on 4/6 benchmarks
SmolLM2 135M Instruct wins 4 of 6 shared benchmarks. Leads in general · language · reasoning.
Category leads
general·SmolLM2 135M Instructknowledge·Gpt Neo 125mlanguage·SmolLM2 135M Instructmath·Gpt Neo 125mreasoning·SmolLM2 135M Instruct
Hype vs Reality
Attention vs performance
Gpt Neo 125m
#238 by perf·no signal
SmolLM2 135M Instruct
#220 by perf·no signal
Vendor risk
Who is behind the model
eleutherai
private · undisclosed
HF
Hugging Face TB
private · undisclosed
Head to head
6 benchmarks · 2 models
Gpt Neo 125mSmolLM2 135M Instruct
BBH (HuggingFace)
SmolLM2 135M Instruct leads by +1.3
Gpt Neo 125m
3.4
SmolLM2 135M Instruct
4.7
GPQA
Gpt Neo 125m leads by +0.5
Gpt Neo 125m
0.5
SmolLM2 135M Instruct
0.0
IFEval
SmolLM2 135M Instruct leads by +9.8
Gpt Neo 125m
19.1
SmolLM2 135M Instruct
28.8
MATH Level 5
Gpt Neo 125m leads by +0.3
Gpt Neo 125m
0.6
SmolLM2 135M Instruct
0.3
MMLU-PRO
SmolLM2 135M Instruct leads by +1.0
Gpt Neo 125m
0.3
SmolLM2 135M Instruct
1.3
MUSR
SmolLM2 135M Instruct leads by +1.1
Gpt Neo 125m
2.6
SmolLM2 135M Instruct
3.7
Full benchmark table
| Benchmark | Gpt Neo 125m | SmolLM2 135M Instruct |
|---|---|---|
BBH (HuggingFace) | 3.4 | 4.7 |
GPQA | 0.5 | 0.0 |
IFEval | 19.1 | 28.8 |
MATH Level 5 | 0.6 | 0.3 |
MMLU-PRO | 0.3 | 1.3 |
MUSR | 2.6 | 3.7 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| Gpt Neo 125m | — | — | — | — |
HF SmolLM2 135M Instruct | — | — | — | — |