Compare · ModelsLive · 2 picked · head to head
Gemma 4 26B A4B vs Grok-3 mini
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Grok-3 mini wins on 2/3 benchmarks
Grok-3 mini wins 2 of 3 shared benchmarks. Leads in knowledge · coding.
Category leads
knowledge·Grok-3 minimath·Gemma 4 26B A4B coding·Grok-3 mini
Hype vs Reality
Attention vs performance
Gemma 4 26B A4B
#151 by perf·#7 by attention
Grok-3 mini
#93 by perf·no signal
Vendor risk
Who is behind the model
Google DeepMind
$4.20T·Tier 1
xAI
$250.0B·Tier 1
Head to head
3 benchmarks · 2 models
Gemma 4 26B A4B Grok-3 mini
GPQA diamond
Grok-3 mini leads by +4.0
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Gemma 4 26B A4B
64.3
Grok-3 mini
68.3
OTIS Mock AIME 2024-2025
Gemma 4 26B A4B leads by +4.4
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Gemma 4 26B A4B
82.2
Grok-3 mini
77.8
WeirdML
Grok-3 mini leads by +7.4
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
Gemma 4 26B A4B
35.2
Grok-3 mini
42.6
Full benchmark table
| Benchmark | Gemma 4 26B A4B | Grok-3 mini |
|---|---|---|
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 64.3 | 68.3 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 82.2 | 77.8 |
WeirdML WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns. | 35.2 | 42.6 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.07 | $0.23 | 262K tokens (~131 books) | $1.07 | |
| — | — | — | — |