Compare · ModelsLive · 2 picked · head to head
Qwen3 Max vs Grok 4
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Grok 4 wins on 4/6 benchmarks
Grok 4 wins 4 of 6 shared benchmarks. Leads in knowledge · math.
Category leads
knowledge·Grok 4math·Grok 4
Hype vs Reality
Attention vs performance
Qwen3 Max
#49 by perf·no signal
Grok 4
#73 by perf·no signal
Best value
Qwen3 Max
4.1x better value than Grok 4
Qwen3 Max
24.9 pts/$
$2.34/M
Grok 4
6.1 pts/$
$9.00/M
Vendor risk
Who is behind the model
Alibaba (Qwen)
$293.0B·Tier 1
xAI
$250.0B·Tier 1
Head to head
6 benchmarks · 2 models
Qwen3 MaxGrok 4
Chess Puzzles
Grok 4 leads by +24.0
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Qwen3 Max
4.0
Grok 4
28.0
Fiction.LiveBench
Grok 4 leads by +27.7
Fiction.LiveBench · a continuously updated benchmark using recently published fiction to test reading comprehension and reasoning, preventing data contamination.
Qwen3 Max
66.7
Grok 4
94.4
GPQA diamond
Grok 4 leads by +19.2
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Qwen3 Max
63.5
Grok 4
82.7
Lech Mazur Writing
Qwen3 Max leads by +6.4
Lech Mazur Writing · evaluates creative writing ability, assessing prose quality, narrative coherence, and stylistic sophistication.
Qwen3 Max
87.1
Grok 4
80.7
OTIS Mock AIME 2024-2025
Grok 4 leads by +10.7
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Qwen3 Max
73.3
Grok 4
84.0
SimpleQA Verified
Qwen3 Max leads by +19.6
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
Qwen3 Max
67.5
Grok 4
47.9
Full benchmark table
| Benchmark | Qwen3 Max | Grok 4 |
|---|---|---|
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 4.0 | 28.0 |
Fiction.LiveBench Fiction.LiveBench · a continuously updated benchmark using recently published fiction to test reading comprehension and reasoning, preventing data contamination. | 66.7 | 94.4 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 63.5 | 82.7 |
Lech Mazur Writing Lech Mazur Writing · evaluates creative writing ability, assessing prose quality, narrative coherence, and stylistic sophistication. | 87.1 | 80.7 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 73.3 | 84.0 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | 67.5 | 47.9 |
Pricing · per 1M tokens · projected $/mo at 10M tokens