Compare · ModelsLive · 2 picked · head to head
Grok 3 Beta vs Grok 4
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Grok 4 wins on 5/6 benchmarks
Grok 4 wins 5 of 6 shared benchmarks. Leads in coding · knowledge · language.
Category leads
coding·Grok 4knowledge·Grok 4language·Grok 4math·Grok 4reasoning·Grok 3 Beta
Hype vs Reality
Attention vs performance
Grok 3 Beta
#16 by perf·no signal
Grok 4
#71 by perf·no signal
Best value
Grok 3 Beta
1.3x better value than Grok 4
Grok 3 Beta
7.7 pts/$
$9.00/M
Grok 4
6.1 pts/$
$9.00/M
Vendor risk
Who is behind the model
xAI
$250.0B·Tier 1
xAI
$250.0B·Tier 1
Head to head
6 benchmarks · 2 models
Grok 3 BetaGrok 4
Aider polyglot
Grok 4 leads by +26.3
Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework.
Grok 3 Beta
53.3
Grok 4
79.6
HELM · GPQA
Grok 4 leads by +7.6
Grok 3 Beta
65.0
Grok 4
72.6
HELM · IFEval
Grok 4 leads by +6.5
Grok 3 Beta
88.4
Grok 4
94.9
HELM · MMLU-Pro
Grok 4 leads by +6.3
Grok 3 Beta
78.8
Grok 4
85.1
HELM · Omni-MATH
Grok 4 leads by +13.9
Grok 3 Beta
46.4
Grok 4
60.3
HELM · WildBench
Grok 3 Beta leads by +5.2
Grok 3 Beta
84.9
Grok 4
79.7
Full benchmark table
| Benchmark | Grok 3 Beta | Grok 4 |
|---|---|---|
Aider polyglot Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework. | 53.3 | 79.6 |
HELM · GPQA | 65.0 | 72.6 |
HELM · IFEval | 88.4 | 94.9 |
HELM · MMLU-Pro | 78.8 | 85.1 |
HELM · Omni-MATH | 46.4 | 60.3 |
HELM · WildBench | 84.9 | 79.7 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| Grok 3 Beta | $3.00 | $15.00 | 131K tokens (~66 books) | $60.00 |
| Grok 4 | $3.00 | $15.00 | 256K tokens (~128 books) | $60.00 |