Compare · ModelsLive · 2 picked · head to head
Grok 4 vs Qwen3 Max
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Grok 4 wins on 4/6 benchmarks
Grok 4 wins 4 of 6 shared benchmarks. Leads in knowledge · math.
Category leads
knowledge·Grok 4math·Grok 4
Hype vs Reality
Attention vs performance
Grok 4
#73 by perf·no signal
Qwen3 Max
#49 by perf·no signal
Best value
Qwen3 Max
4.1x better value than Grok 4
Grok 4
6.1 pts/$
$9.00/M
Qwen3 Max
24.9 pts/$
$2.34/M
Vendor risk
Who is behind the model
xAI
$250.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
6 benchmarks · 2 models
Grok 4Qwen3 Max
Chess Puzzles
Grok 4 leads by +24.0
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Grok 4
28.0
Qwen3 Max
4.0
Fiction.LiveBench
Grok 4 leads by +27.7
Fiction.LiveBench · a continuously updated benchmark using recently published fiction to test reading comprehension and reasoning, preventing data contamination.
Grok 4
94.4
Qwen3 Max
66.7
GPQA diamond
Grok 4 leads by +19.2
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Grok 4
82.7
Qwen3 Max
63.5
Lech Mazur Writing
Qwen3 Max leads by +6.4
Lech Mazur Writing · evaluates creative writing ability, assessing prose quality, narrative coherence, and stylistic sophistication.
Grok 4
80.7
Qwen3 Max
87.1
OTIS Mock AIME 2024-2025
Grok 4 leads by +10.7
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Grok 4
84.0
Qwen3 Max
73.3
SimpleQA Verified
Qwen3 Max leads by +19.6
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
Grok 4
47.9
Qwen3 Max
67.5
Full benchmark table
| Benchmark | Grok 4 | Qwen3 Max |
|---|---|---|
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 28.0 | 4.0 |
Fiction.LiveBench Fiction.LiveBench · a continuously updated benchmark using recently published fiction to test reading comprehension and reasoning, preventing data contamination. | 94.4 | 66.7 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 82.7 | 63.5 |
Lech Mazur Writing Lech Mazur Writing · evaluates creative writing ability, assessing prose quality, narrative coherence, and stylistic sophistication. | 80.7 | 87.1 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 84.0 | 73.3 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | 47.9 | 67.5 |
Pricing · per 1M tokens · projected $/mo at 10M tokens