Compare · ModelsLive · 2 picked · head to head
Grok 4 vs Qwen3.8 Max (0902)
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Qwen3.8 Max (0902) wins on 4/5 benchmarks
Qwen3.8 Max (0902) wins 4 of 5 shared benchmarks. Leads in agentic · knowledge · math.
Category leads
agentic·Qwen3.8 Max (0902)knowledge·Qwen3.8 Max (0902)math·Qwen3.8 Max (0902)
Hype vs Reality
Attention vs performance
Grok 4
#99 by perf·#14 by attention
Qwen3.8 Max (0902)
#87 by perf·#1 by attention
Vendor risk
Who is behind the model
xAI
$250.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
5 benchmarks · 2 models
Grok 4Qwen3.8 Max (0902)
APEX-Agents
Qwen3.8 Max (0902) leads by +48.1
APEX-Agents · evaluates AI agents on complex, multi-step tasks requiring planning, tool use, and autonomous decision-making in realistic environments.
Grok 4
15.2
Qwen3.8 Max (0902)
63.3
Chess Puzzles
Qwen3.8 Max (0902) leads by +15.2
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Grok 4
28.0
Qwen3.8 Max (0902)
43.2
GPQA diamond
Qwen3.8 Max (0902) leads by +7.9
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Grok 4
86.1
Qwen3.8 Max (0902)
94.0
OTIS Mock AIME 2024-2025
Qwen3.8 Max (0902) leads by +15.5
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Grok 4
84.0
Qwen3.8 Max (0902)
99.4
SimpleQA Verified
Grok 4 leads by +2.1
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
Grok 4
47.9
Qwen3.8 Max (0902)
45.8
Full benchmark table
| Benchmark | Grok 4 | Qwen3.8 Max (0902) |
|---|---|---|
APEX-Agents APEX-Agents · evaluates AI agents on complex, multi-step tasks requiring planning, tool use, and autonomous decision-making in realistic environments. | 15.2 | 63.3 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 28.0 | 43.2 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 86.1 | 94.0 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 84.0 | 99.4 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | 47.9 | 45.8 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| n/a | n/a | n/a | n/a | |
| $2.00 | $6.00 | 1.0M tokens (~500 books) | $30.00 |
People also compared