Compare · ModelsLive · 2 picked · head to head

GPT-5.1 vs Grok 4.20

Side by side · benchmarks, pricing, and signals you can act on.

Winner summary

GPT-5.1 wins 7 of 12 shared benchmarks. Leads in knowledge · general.

Category leads
reasoning·Grok 4.20knowledge·GPT-5.1general·GPT-5.1math·Grok 4.20coding·Grok 4.20

Head to head · from the data · data as of 2026-11-17

  • Benchmarks · GPT-5.1 leads on 6 of 12 shared benchmarks (Chess Puzzles, Cl Bench, Cl Bench Life, Lmca, 2 more), Grok 4.20 on 5 (ARC-AGI, ARC-AGI-2, GPQA diamond, OTIS Mock AIME 2024-2025, 1 more) · 1 tied
  • Price · GPT-5.1 input $1.25/M vs Grok 4.20 $1.25/M, the same input price (OpenRouter list price, as of 2026-11-17)
  • Cheapest provider · GPT-5.1 at OpenAI $0.63/M input (of 5 offers) as of 2026-11-17 · Grok 4.20 at xAI and 1 other provider $1.25/M input (of 4 offers) as of 2026-11-17
  • Context · GPT-5.1 400K tokens vs Grok 4.20 2.0M tokens
  • Released · GPT-5.1 Nov 13, 2025 vs Grok 4.20 Mar 31, 2026 · 4 months apart
  • Price history · GPT-5.1 OpenRouter input list price had no move of 5% or more in the 90 days to 2026-11-17 · Grok 4.20 OpenRouter input list price had no move of 5% or more in the 90 days to 2026-11-17

Sources · scores from public leaderboards, list prices and provider offers from OpenRouter, price moves from the BenchGecko changelog (5% or more, held in the next daily check), Gecko tests run by BenchGecko.

Hype vs Reality
GPT-5.1
#157 by perf·#11 by attention
UNDERRATED
Grok 4.20
#139 by perf·#17 by attention
UNDERRATED
Best value
3.1x better value than GPT-5.1
GPT-5.1
8.4 pts/$
$5.63/M
Grok 4.20
26.4 pts/$
$1.88/M
Vendor risk
OpenAI logo
OpenAI
$840.0B·Tier 1
Medium risk
xAI logo
xAI
$250.0B·Tier 1
Medium risk
Head to head
GPT-5.1Grok 4.20
ARC-AGI
Grok 4.20 leads by +16.7
ARC-AGI · the original Abstraction and Reasoning Corpus, testing whether AI can solve novel visual pattern recognition tasks without memorization.
GPT-5.1
72.8
Grok 4.20
89.5
ARC-AGI-2
Grok 4.20 leads by +47.5
ARC-AGI-2 · the second iteration of the Abstraction and Reasoning Corpus, testing novel pattern recognition and abstract reasoning without prior training data.
GPT-5.1
17.6
Grok 4.20
65.1
Chess Puzzles
GPT-5.1 leads by +13.7
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
GPT-5.1
39.0
Grok 4.20
25.3
Cl Bench
GPT-5.1 leads by +1.5
GPT-5.1
23.7
Grok 4.20
22.2
Cl Bench Life
GPT-5.1 leads by +5.4
GPT-5.1
17.3
Grok 4.20
11.9
Dtbench
GPT-5.1
83.5
Grok 4.20
83.5
GPQA diamond
Grok 4.20 leads by +2.4
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
GPT-5.1
87.0
Grok 4.20
89.3
Lmca
GPT-5.1 leads by +6.2
GPT-5.1
51.6
Grok 4.20
45.5
OTIS Mock AIME 2024-2025
Grok 4.20 leads by +3.6
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
GPT-5.1
88.6
Grok 4.20
92.2
SimpleQA Verified
GPT-5.1 leads by +17.8
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
GPT-5.1
48.0
Grok 4.20
30.2
Terminal Bench
Grok 4.20 leads by +9.7
Terminal-Bench 2.0 · evaluates AI agents on real terminal-based coding tasks · writing scripts, debugging, running tests, and managing projects entirely through command-line interaction. Tests both code quality and terminal fluency.
GPT-5.1
47.6
Grok 4.20
57.3
WeirdML
GPT-5.1 leads by +8.5
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
GPT-5.1
60.8
Grok 4.20
52.3
Full benchmark table
BenchmarkGPT-5.1Grok 4.20
ARC-AGI
ARC-AGI · the original Abstraction and Reasoning Corpus, testing whether AI can solve novel visual pattern recognition tasks without memorization.
72.889.5
ARC-AGI-2
ARC-AGI-2 · the second iteration of the Abstraction and Reasoning Corpus, testing novel pattern recognition and abstract reasoning without prior training data.
17.665.1
Chess Puzzles
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
39.025.3
Cl Bench
23.722.2
Cl Bench Life
17.311.9
Dtbench
83.583.5
GPQA diamond
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
87.089.3
Lmca
51.645.5
OTIS Mock AIME 2024-2025
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
88.692.2
SimpleQA Verified
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
48.030.2
Terminal Bench
Terminal-Bench 2.0 · evaluates AI agents on real terminal-based coding tasks · writing scripts, debugging, running tests, and managing projects entirely through command-line interaction. Tests both code quality and terminal fluency.
47.657.3
WeirdML
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
60.852.3
Pricing · per 1M tokens · projected $/mo at 10M tokens
ModelInputOutputContextProjected $/mo
OpenAI logoGPT-5.1$1.25$10.00400K tokens (~200 books)$34.38
xAI logoGrok 4.20$1.25$2.502.0M tokens (~1,000 books)$15.63
GPT-5.1 leads on 6 of 12 shared benchmarks (Chess Puzzles, Cl Bench, Cl Bench Life, Lmca, 2 more), Grok 4.20 on 5 (ARC-AGI, ARC-AGI-2, GPQA diamond, OTIS Mock AIME 2024-2025, 1 more) · 1 tied