Compare · ModelsLive · 2 picked · head to head
Palmyra X5 vs o4 Mini
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
o4 Mini wins on 5/5 benchmarks
o4 Mini wins 5 of 5 shared benchmarks. Leads in knowledge · language · math.
Category leads
knowledge·o4 Minilanguage·o4 Minimath·o4 Minireasoning·o4 Mini
Hype vs Reality
Attention vs performance
Palmyra X5
#17 by perf·no signal
o4 Mini
#81 by perf·#13 by attention
Best value
Palmyra X5
1.1x better value than o4 Mini
Palmyra X5
21.1 pts/$
$3.30/M
o4 Mini
19.3 pts/$
$2.75/M
Vendor risk
Who is behind the model
writer
private · undisclosed
OpenAI
$840.0B·Tier 1
Head to head
5 benchmarks · 2 models
Palmyra X5o4 Mini
HELM · GPQA
o4 Mini leads by +7.4
Palmyra X5
66.1
o4 Mini
73.5
HELM · IFEval
o4 Mini leads by +10.6
Palmyra X5
82.3
o4 Mini
92.9
HELM · MMLU-Pro
o4 Mini leads by +1.6
Palmyra X5
80.4
o4 Mini
82.0
HELM · Omni-MATH
o4 Mini leads by +30.5
Palmyra X5
41.5
o4 Mini
72.0
HELM · WildBench
o4 Mini leads by +7.4
Palmyra X5
78.0
o4 Mini
85.4
Full benchmark table
| Benchmark | Palmyra X5 | o4 Mini |
|---|---|---|
HELM · GPQA | 66.1 | 73.5 |
HELM · IFEval | 82.3 | 92.9 |
HELM · MMLU-Pro | 80.4 | 82.0 |
HELM · Omni-MATH | 41.5 | 72.0 |
HELM · WildBench | 78.0 | 85.4 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.60 | $6.00 | 1.0M tokens (~520 books) | $19.50 | |
| $1.10 | $4.40 | 200K tokens (~100 books) | $19.25 |