Compare · ModelsLive · 2 picked · head to head
Claude Opus 4.8 vs Qwen3.5 397B A17B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Claude Opus 4.8 wins on 10/10 benchmarks
Claude Opus 4.8 wins 10 of 10 shared benchmarks. Leads in agentic · arena · knowledge.
Category leads
agentic·Claude Opus 4.8arena·Claude Opus 4.8knowledge·Claude Opus 4.8general·Claude Opus 4.8math·Claude Opus 4.8
Hype vs Reality
Attention vs performance
Claude Opus 4.8
#72 by perf·#5 by attention
Qwen3.5 397B A17B
#53 by perf·#1 by attention
Best value
Qwen3.5 397B A17B
7.6x better value than Claude Opus 4.8
Claude Opus 4.8
3.8 pts/$
$15.00/M
Qwen3.5 397B A17B
28.7 pts/$
$2.10/M
Vendor risk
Who is behind the model
Anthropic
$965.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
10 benchmarks · 2 models
Claude Opus 4.8Qwen3.5 397B A17B
APEX-Agents
Claude Opus 4.8 leads by +24.0
APEX-Agents · evaluates AI agents on complex, multi-step tasks requiring planning, tool use, and autonomous decision-making in realistic environments.
Claude Opus 4.8
48.9
Qwen3.5 397B A17B
24.9
Chatbot Arena Elo · Coding
Claude Opus 4.8 leads by +134.7
Claude Opus 4.8
1534.1
Qwen3.5 397B A17B
1399.4
Chatbot Arena Elo · Overall
Claude Opus 4.8 leads by +32.7
Claude Opus 4.8
1474.5
Qwen3.5 397B A17B
1441.8
Chess Puzzles
Claude Opus 4.8 leads by +41.0
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Claude Opus 4.8
49.5
Qwen3.5 397B A17B
8.5
Dtbench
Claude Opus 4.8 leads by +12.4
Claude Opus 4.8
91.5
Qwen3.5 397B A17B
79.1
FrontierMath-Tiers-1-3-v2-Private
Claude Opus 4.8 leads by +51.3
Claude Opus 4.8
84.2
Qwen3.5 397B A17B
32.9
GPQA diamond
Claude Opus 4.8 leads by +6.5
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Claude Opus 4.8
91.7
Qwen3.5 397B A17B
85.2
Lmca
Claude Opus 4.8 leads by +23.1
Claude Opus 4.8
67.7
Qwen3.5 397B A17B
44.6
Mystery Game Puzzles
Claude Opus 4.8 leads by +19.8
Claude Opus 4.8
29.5
Qwen3.5 397B A17B
9.7
OTIS Mock AIME 2024-2025
Claude Opus 4.8 leads by +9.5
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Claude Opus 4.8
98.3
Qwen3.5 397B A17B
88.9
Full benchmark table
| Benchmark | Claude Opus 4.8 | Qwen3.5 397B A17B |
|---|---|---|
APEX-Agents APEX-Agents · evaluates AI agents on complex, multi-step tasks requiring planning, tool use, and autonomous decision-making in realistic environments. | 48.9 | 24.9 |
Chatbot Arena Elo · Coding | 1534.1 | 1399.4 |
Chatbot Arena Elo · Overall | 1474.5 | 1441.8 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 49.5 | 8.5 |
Dtbench | 91.5 | 79.1 |
FrontierMath-Tiers-1-3-v2-Private | 84.2 | 32.9 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 91.7 | 85.2 |
Lmca | 67.7 | 44.6 |
Mystery Game Puzzles | 29.5 | 9.7 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 98.3 | 88.9 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $5.00 | $25.00 | 1.0M tokens (~500 books) | $100.00 | |
| $0.60 | $3.60 | 262K tokens (~131 books) | $13.50 |