Compare · ModelsLive · 2 picked · head to head
o3 vs Palmyra X5
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
o3 wins on 5/5 benchmarks
o3 wins 5 of 5 shared benchmarks. Leads in knowledge · language · math.
Category leads
knowledge·o3language·o3math·o3reasoning·o3
Hype vs Reality
Attention vs performance
o3
#69 by perf·no signal
Palmyra X5
#17 by perf·no signal
Best value
Palmyra X5
1.9x better value than o3
o3
11.0 pts/$
$5.00/M
Palmyra X5
21.1 pts/$
$3.30/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
writer
private · undisclosed
Head to head
5 benchmarks · 2 models
o3Palmyra X5
HELM · GPQA
o3 leads by +9.2
o3
75.3
Palmyra X5
66.1
HELM · IFEval
o3 leads by +4.6
o3
86.9
Palmyra X5
82.3
HELM · MMLU-Pro
o3 leads by +5.5
o3
85.9
Palmyra X5
80.4
HELM · Omni-MATH
o3 leads by +29.9
o3
71.4
Palmyra X5
41.5
HELM · WildBench
o3 leads by +8.1
o3
86.1
Palmyra X5
78.0
Full benchmark table
| Benchmark | o3 | Palmyra X5 |
|---|---|---|
HELM · GPQA | 75.3 | 66.1 |
HELM · IFEval | 86.9 | 82.3 |
HELM · MMLU-Pro | 85.9 | 80.4 |
HELM · Omni-MATH | 71.4 | 41.5 |
HELM · WildBench | 86.1 | 78.0 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $2.00 | $8.00 | 200K tokens (~100 books) | $35.00 | |
| $0.60 | $6.00 | 1.0M tokens (~520 books) | $19.50 |