Compare · ModelsLive · 2 picked · head to head
GPT-5.1 vs Grok 4.20
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GPT-5.1 wins on 7/12 benchmarks
GPT-5.1 wins 7 of 12 shared benchmarks. Leads in knowledge · general.
Category leads
reasoning·Grok 4.20knowledge·GPT-5.1general·GPT-5.1math·Grok 4.20coding·Grok 4.20
Head to head · from the data · data as of 2026-11-17
- Benchmarks · GPT-5.1 leads on 6 of 12 shared benchmarks (Chess Puzzles, Cl Bench, Cl Bench Life, Lmca, 2 more), Grok 4.20 on 5 (ARC-AGI, ARC-AGI-2, GPQA diamond, OTIS Mock AIME 2024-2025, 1 more) · 1 tied
- Price · GPT-5.1 input $1.25/M vs Grok 4.20 $1.25/M, the same input price (OpenRouter list price, as of 2026-11-17)
- Cheapest provider · GPT-5.1 at OpenAI $0.63/M input (of 5 offers) as of 2026-11-17 · Grok 4.20 at xAI and 1 other provider $1.25/M input (of 4 offers) as of 2026-11-17
- Context · GPT-5.1 400K tokens vs Grok 4.20 2.0M tokens
- Released · GPT-5.1 Nov 13, 2025 vs Grok 4.20 Mar 31, 2026 · 4 months apart
- Price history · GPT-5.1 OpenRouter input list price had no move of 5% or more in the 90 days to 2026-11-17 · Grok 4.20 OpenRouter input list price had no move of 5% or more in the 90 days to 2026-11-17
Sources · scores from public leaderboards, list prices and provider offers from OpenRouter, price moves from the BenchGecko changelog (5% or more, held in the next daily check), Gecko tests run by BenchGecko.
Hype vs Reality
Attention vs performance
GPT-5.1
#157 by perf·#11 by attention
Grok 4.20
#139 by perf·#17 by attention
Best value
Grok 4.20
3.1x better value than GPT-5.1
GPT-5.1
8.4 pts/$
$5.63/M
Grok 4.20
26.4 pts/$
$1.88/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
xAI
$250.0B·Tier 1
Head to head
12 benchmarks · 2 models
GPT-5.1Grok 4.20
ARC-AGI
Grok 4.20 leads by +16.7
ARC-AGI · the original Abstraction and Reasoning Corpus, testing whether AI can solve novel visual pattern recognition tasks without memorization.
GPT-5.1
72.8
Grok 4.20
89.5
ARC-AGI-2
Grok 4.20 leads by +47.5
ARC-AGI-2 · the second iteration of the Abstraction and Reasoning Corpus, testing novel pattern recognition and abstract reasoning without prior training data.
GPT-5.1
17.6
Grok 4.20
65.1
Chess Puzzles
GPT-5.1 leads by +13.7
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
GPT-5.1
39.0
Grok 4.20
25.3
Cl Bench
GPT-5.1 leads by +1.5
GPT-5.1
23.7
Grok 4.20
22.2
Cl Bench Life
GPT-5.1 leads by +5.4
GPT-5.1
17.3
Grok 4.20
11.9
Dtbench
GPT-5.1
83.5
Grok 4.20
83.5
GPQA diamond
Grok 4.20 leads by +2.4
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
GPT-5.1
87.0
Grok 4.20
89.3
Lmca
GPT-5.1 leads by +6.2
GPT-5.1
51.6
Grok 4.20
45.5
OTIS Mock AIME 2024-2025
Grok 4.20 leads by +3.6
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
GPT-5.1
88.6
Grok 4.20
92.2
SimpleQA Verified
GPT-5.1 leads by +17.8
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
GPT-5.1
48.0
Grok 4.20
30.2
Terminal Bench
Grok 4.20 leads by +9.7
Terminal-Bench 2.0 · evaluates AI agents on real terminal-based coding tasks · writing scripts, debugging, running tests, and managing projects entirely through command-line interaction. Tests both code quality and terminal fluency.
GPT-5.1
47.6
Grok 4.20
57.3
WeirdML
GPT-5.1 leads by +8.5
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
GPT-5.1
60.8
Grok 4.20
52.3
Full benchmark table
| Benchmark | GPT-5.1 | Grok 4.20 |
|---|---|---|
ARC-AGI ARC-AGI · the original Abstraction and Reasoning Corpus, testing whether AI can solve novel visual pattern recognition tasks without memorization. | 72.8 | 89.5 |
ARC-AGI-2 ARC-AGI-2 · the second iteration of the Abstraction and Reasoning Corpus, testing novel pattern recognition and abstract reasoning without prior training data. | 17.6 | 65.1 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 39.0 | 25.3 |
Cl Bench | 23.7 | 22.2 |
Cl Bench Life | 17.3 | 11.9 |
Dtbench | 83.5 | 83.5 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 87.0 | 89.3 |
Lmca | 51.6 | 45.5 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 88.6 | 92.2 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | 48.0 | 30.2 |
Terminal Bench Terminal-Bench 2.0 · evaluates AI agents on real terminal-based coding tasks · writing scripts, debugging, running tests, and managing projects entirely through command-line interaction. Tests both code quality and terminal fluency. | 47.6 | 57.3 |
WeirdML WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns. | 60.8 | 52.3 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
GPT-5.1 vs Grok 4.20 · questions answered from the data
GPT-5.1 leads on 6 of 12 shared benchmarks (Chess Puzzles, Cl Bench, Cl Bench Life, Lmca, 2 more), Grok 4.20 on 5 (ARC-AGI, ARC-AGI-2, GPQA diamond, OTIS Mock AIME 2024-2025, 1 more) · 1 tied
People also compared