Compare · ModelsLive · 2 picked · head to head
GLM 5.1 vs Qwen3.5 397B A17B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GLM 5.1 wins on 10/10 benchmarks
GLM 5.1 wins 10 of 10 shared benchmarks. Leads in speed · agentic · arena.
Category leads
speed·GLM 5.1agentic·GLM 5.1arena·GLM 5.1knowledge·GLM 5.1math·GLM 5.1
Hype vs Reality
Attention vs performance
GLM 5.1
#84 by perf·#3 by attention
Qwen3.5 397B A17B
#48 by perf·#2 by attention
Best value
Qwen3.5 397B A17B
1.1x better value than GLM 5.1
GLM 5.1
27.1 pts/$
$2.00/M
Qwen3.5 397B A17B
29.6 pts/$
$2.02/M
Vendor risk
Who is behind the model
z-ai
private · undisclosed
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
10 benchmarks · 2 models
GLM 5.1Qwen3.5 397B A17B
Artificial Analysis · Agentic Index
GLM 5.1 leads by +10.0
Artificial Analysis Agentic Index · a composite score measuring how well a model performs in agentic workflows · multi-step tool use, planning, error recovery, and autonomous task completion. Aggregates results from multiple agentic benchmarks including SWE-bench, tool-use tests, and planning evaluations. The canonical single-number metric for "how good is this model as an agent?"
GLM 5.1
29.9
Qwen3.5 397B A17B
19.9
Artificial Analysis · Coding Index
GLM 5.1 leads by +7.6
Artificial Analysis Coding Index · a composite score that aggregates performance across multiple coding benchmarks into a single index. Tracks code generation quality, debugging ability, multi-language competence, and real-world software engineering tasks. Used by Artificial Analysis to rank model coding capability in a normalized, comparable format. Useful for developers choosing between models for coding-heavy workloads.
GLM 5.1
55.8
Qwen3.5 397B A17B
48.2
Artificial Analysis · Quality Index
GLM 5.1 leads by +18.7
GLM 5.1
40.2
Qwen3.5 397B A17B
21.4
APEX-Agents
GLM 5.1 leads by +16.0
APEX-Agents · evaluates AI agents on complex, multi-step tasks requiring planning, tool use, and autonomous decision-making in realistic environments.
GLM 5.1
40.9
Qwen3.5 397B A17B
24.9
Chatbot Arena Elo · Coding
GLM 5.1 leads by +109.1
GLM 5.1
1508.5
Qwen3.5 397B A17B
1399.4
Chatbot Arena Elo · Overall
GLM 5.1 leads by +22.8
GLM 5.1
1464.6
Qwen3.5 397B A17B
1441.8
Chess Puzzles
GLM 5.1 leads by +6.3
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
GLM 5.1
14.8
Qwen3.5 397B A17B
8.5
FrontierMath-Tiers-1-3-v2-Private
GLM 5.1 leads by +5.6
GLM 5.1
36.8
Qwen3.5 397B A17B
31.2
GPQA diamond
GLM 5.1 leads by +4.7
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
GLM 5.1
86.5
Qwen3.5 397B A17B
81.8
OTIS Mock AIME 2024-2025
GLM 5.1 leads by +4.5
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
GLM 5.1
93.3
Qwen3.5 397B A17B
88.9
Full benchmark table
| Benchmark | GLM 5.1 | Qwen3.5 397B A17B |
|---|---|---|
Artificial Analysis · Agentic Index Artificial Analysis Agentic Index · a composite score measuring how well a model performs in agentic workflows · multi-step tool use, planning, error recovery, and autonomous task completion. Aggregates results from multiple agentic benchmarks including SWE-bench, tool-use tests, and planning evaluations. The canonical single-number metric for "how good is this model as an agent?" | 29.9 | 19.9 |
Artificial Analysis · Coding Index Artificial Analysis Coding Index · a composite score that aggregates performance across multiple coding benchmarks into a single index. Tracks code generation quality, debugging ability, multi-language competence, and real-world software engineering tasks. Used by Artificial Analysis to rank model coding capability in a normalized, comparable format. Useful for developers choosing between models for coding-heavy workloads. | 55.8 | 48.2 |
Artificial Analysis · Quality Index | 40.2 | 21.4 |
APEX-Agents APEX-Agents · evaluates AI agents on complex, multi-step tasks requiring planning, tool use, and autonomous decision-making in realistic environments. | 40.9 | 24.9 |
Chatbot Arena Elo · Coding | 1508.5 | 1399.4 |
Chatbot Arena Elo · Overall | 1464.6 | 1441.8 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 14.8 | 8.5 |
FrontierMath-Tiers-1-3-v2-Private | 36.8 | 31.2 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 86.5 | 81.8 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 93.3 | 88.9 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.97 | $3.04 | 205K tokens (~102 books) | $14.83 | |
| $0.55 | $3.50 | 262K tokens (~131 books) | $12.88 |