Compare · ModelsLive · 2 picked · head to head
o4 Mini vs Palmyra X5
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
o4 Mini wins on 5/5 benchmarks
o4 Mini wins 5 of 5 shared benchmarks. Leads in knowledge · language · math.
Category leads
knowledge·o4 Minilanguage·o4 Minimath·o4 Minireasoning·o4 Mini
Hype vs Reality
Attention vs performance
o4 Mini
#81 by perf·#13 by attention
Palmyra X5
#17 by perf·no signal
Best value
Palmyra X5
1.1x better value than o4 Mini
o4 Mini
19.3 pts/$
$2.75/M
Palmyra X5
21.1 pts/$
$3.30/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
writer
private · undisclosed
Head to head
5 benchmarks · 2 models
o4 MiniPalmyra X5
HELM · GPQA
o4 Mini leads by +7.4
o4 Mini
73.5
Palmyra X5
66.1
HELM · IFEval
o4 Mini leads by +10.6
o4 Mini
92.9
Palmyra X5
82.3
HELM · MMLU-Pro
o4 Mini leads by +1.6
o4 Mini
82.0
Palmyra X5
80.4
HELM · Omni-MATH
o4 Mini leads by +30.5
o4 Mini
72.0
Palmyra X5
41.5
HELM · WildBench
o4 Mini leads by +7.4
o4 Mini
85.4
Palmyra X5
78.0
Full benchmark table
| Benchmark | o4 Mini | Palmyra X5 |
|---|---|---|
HELM · GPQA | 73.5 | 66.1 |
HELM · IFEval | 92.9 | 82.3 |
HELM · MMLU-Pro | 82.0 | 80.4 |
HELM · Omni-MATH | 72.0 | 41.5 |
HELM · WildBench | 85.4 | 78.0 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $1.10 | $4.40 | 200K tokens (~100 books) | $19.25 | |
| $0.60 | $6.00 | 1.0M tokens (~520 books) | $19.50 |