Compare · ModelsLive · 2 picked · head to head
Gemma 4 31B vs GLM 5.1
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GLM 5.1 wins on 16/16 benchmarks
GLM 5.1 wins 16 of 16 shared benchmarks. Leads in speed · arena · knowledge.
Category leads
speed·GLM 5.1arena·GLM 5.1knowledge·GLM 5.1coding·GLM 5.1reasoning·GLM 5.1language·GLM 5.1math·GLM 5.1
Hype vs Reality
Attention vs performance
Gemma 4 31B
#101 by perf·#8 by attention
GLM 5.1
#84 by perf·#3 by attention
Best value
Gemma 4 31B
9.0x better value than GLM 5.1
Gemma 4 31B
245.6 pts/$
$0.22/M
GLM 5.1
27.1 pts/$
$2.00/M
Vendor risk
Who is behind the model
Google DeepMind
$4.20T·Tier 1
z-ai
private · undisclosed
Head to head
16 benchmarks · 2 models
Gemma 4 31BGLM 5.1
Artificial Analysis · Quality Index
GLM 5.1 leads by +25.5
Gemma 4 31B
14.7
GLM 5.1
40.2
Chatbot Arena Elo · Coding
GLM 5.1 leads by +143.8
Gemma 4 31B
1364.7
GLM 5.1
1508.5
Chatbot Arena Elo · Overall
GLM 5.1 leads by +11.7
Gemma 4 31B
1452.8
GLM 5.1
1464.6
Chess Puzzles
GLM 5.1 leads by +14.7
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Gemma 4 31B
0.0
GLM 5.1
14.8
GPQA diamond
GLM 5.1 leads by +18.8
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Gemma 4 31B
67.7
GLM 5.1
86.5
LiveBench · Agentic Coding
GLM 5.1 leads by +15.0
Gemma 4 31B
40.0
GLM 5.1
55.0
LiveBench · Coding
GLM 5.1 leads by +15.0
Gemma 4 31B
60.3
GLM 5.1
75.4
LiveBench · Data Analysis
GLM 5.1 leads by +4.5
Gemma 4 31B
58.8
GLM 5.1
63.2
LiveBench · If
GLM 5.1 leads by +0.9
Gemma 4 31B
67.6
GLM 5.1
68.5
LiveBench · Language
GLM 5.1 leads by +0.4
Gemma 4 31B
71.3
GLM 5.1
71.8
LiveBench · Mathematics
GLM 5.1 leads by +11.0
Gemma 4 31B
73.9
GLM 5.1
84.9
LiveBench · Overall
GLM 5.1 leads by +8.6
Gemma 4 31B
61.6
GLM 5.1
70.2
LiveBench · Reasoning
GLM 5.1 leads by +13.1
Gemma 4 31B
59.4
GLM 5.1
72.5
OTIS Mock AIME 2024-2025
GLM 5.1 leads by +20.0
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Gemma 4 31B
73.3
GLM 5.1
93.3
SimpleQA Verified
GLM 5.1 leads by +23.6
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
Gemma 4 31B
10.4
GLM 5.1
34.0
WeirdML
GLM 5.1 leads by +4.8
WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns.
Gemma 4 31B
52.3
GLM 5.1
57.1
Full benchmark table
| Benchmark | Gemma 4 31B | GLM 5.1 |
|---|---|---|
Artificial Analysis · Quality Index | 14.7 | 40.2 |
Chatbot Arena Elo · Coding | 1364.7 | 1508.5 |
Chatbot Arena Elo · Overall | 1452.8 | 1464.6 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 0.0 | 14.8 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 67.7 | 86.5 |
LiveBench · Agentic Coding | 40.0 | 55.0 |
LiveBench · Coding | 60.3 | 75.4 |
LiveBench · Data Analysis | 58.8 | 63.2 |
LiveBench · If | 67.6 | 68.5 |
LiveBench · Language | 71.3 | 71.8 |
LiveBench · Mathematics | 73.9 | 84.9 |
LiveBench · Overall | 61.6 | 70.2 |
LiveBench · Reasoning | 59.4 | 72.5 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 73.3 | 93.3 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | 10.4 | 34.0 |
WeirdML WeirdML · tests models on unusual and adversarial machine learning tasks that require creative problem-solving beyond standard patterns. | 52.3 | 57.1 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.09 | $0.34 | 262K tokens (~131 books) | $1.53 | |
| $0.97 | $3.04 | 205K tokens (~102 books) | $14.83 |