Compare · ModelsLive · 2 picked · head to head
Grok 3 vs Qwen3 235B A22B Instruct 2507
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Qwen3 235B A22B Instruct 2507 wins on 4/5 benchmarks
Qwen3 235B A22B Instruct 2507 wins 4 of 5 shared benchmarks. Leads in coding · reasoning.
Category leads
coding·Qwen3 235B A22B Instruct 2507reasoning·Qwen3 235B A22B Instruct 2507knowledge·Grok 3
Hype vs Reality
Attention vs performance
Grok 3
#150 by perf·#9 by attention
Qwen3 235B A22B Instruct 2507
#99 by perf·no signal
Best value
Qwen3 235B A22B Instruct 2507
132.9x better value than Grok 3
Grok 3
4.3 pts/$
$9.00/M
Qwen3 235B A22B Instruct 2507
567.3 pts/$
$0.09/M
Vendor risk
Who is behind the model
xAI
$250.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
5 benchmarks · 2 models
Grok 3Qwen3 235B A22B Instruct 2507
Aider polyglot
Qwen3 235B A22B Instruct 2507 leads by +6.3
Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework.
Grok 3
53.3
Qwen3 235B A22B Instruct 2507
59.6
ARC-AGI
Qwen3 235B A22B Instruct 2507 leads by +5.5
ARC-AGI · the original Abstraction and Reasoning Corpus, testing whether AI can solve novel visual pattern recognition tasks without memorization.
Grok 3
5.5
Qwen3 235B A22B Instruct 2507
11.0
ARC-AGI-2
Qwen3 235B A22B Instruct 2507 leads by +1.1
ARC-AGI-2 · the second iteration of the Abstraction and Reasoning Corpus, testing novel pattern recognition and abstract reasoning without prior training data.
Grok 3
0.1
Qwen3 235B A22B Instruct 2507
1.3
Fiction.LiveBench
Grok 3 leads by +5.4
Fiction.LiveBench · a continuously updated benchmark using recently published fiction to test reading comprehension and reasoning, preventing data contamination.
Grok 3
58.3
Qwen3 235B A22B Instruct 2507
52.9
WeirdML
Qwen3 235B A22B Instruct 2507 leads by +1.5
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
Grok 3
37.2
Qwen3 235B A22B Instruct 2507
38.7
Full benchmark table
| Benchmark | Grok 3 | Qwen3 235B A22B Instruct 2507 |
|---|---|---|
Aider polyglot Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework. | 53.3 | 59.6 |
ARC-AGI ARC-AGI · the original Abstraction and Reasoning Corpus, testing whether AI can solve novel visual pattern recognition tasks without memorization. | 5.5 | 11.0 |
ARC-AGI-2 ARC-AGI-2 · the second iteration of the Abstraction and Reasoning Corpus, testing novel pattern recognition and abstract reasoning without prior training data. | 0.1 | 1.3 |
Fiction.LiveBench Fiction.LiveBench · a continuously updated benchmark using recently published fiction to test reading comprehension and reasoning, preventing data contamination. | 58.3 | 52.9 |
WeirdML WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns. | 37.2 | 38.7 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $3.00 | $15.00 | 131K tokens (~66 books) | $60.00 | |
| $0.07 | $0.10 | 262K tokens (~131 books) | $0.78 |
People also compared