Compare · ModelsLive · 3 picked · head to head
GPT-5.1-Codex-Max vs Qwen3.7 Max vs Kimi K2.7 Code
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Qwen3.7 Max wins on 13/17 benchmarks
Qwen3.7 Max wins 13 of 17 shared benchmarks. Leads in reasoning · language · math.
Category leads
coding·Kimi K2.7 Codereasoning·Qwen3.7 Maxlanguage·Qwen3.7 Maxmath·Qwen3.7 Maxknowledge·Qwen3.7 Maxspeed·Qwen3.7 Max
Hype vs Reality
Attention vs performance
GPT-5.1-Codex-Max
#16 by perf·no signal
Qwen3.7 Max
#28 by perf·no signal
Kimi K2.7 Code
#42 by perf·no signal
Best value
Kimi K2.7 Code
1.3x better value than Qwen3.7 Max
GPT-5.1-Codex-Max
12.8 pts/$
$5.63/M
Qwen3.7 Max
27.2 pts/$
$2.50/M
Kimi K2.7 Code
34.3 pts/$
$1.84/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
moonshotai
private · undisclosed
Head to head
17 benchmarks · 3 models
GPT-5.1-Codex-MaxQwen3.7 MaxKimi K2.7 Code
LiveBench · Agentic Coding
Kimi K2.7 Code leads by +13.3
GPT-5.1-Codex-Max
56.7
Qwen3.7 Max
51.7
Kimi K2.7 Code
70.0
LiveBench · Coding
GPT-5.1-Codex-Max leads by +7.2
GPT-5.1-Codex-Max
81.4
Qwen3.7 Max
74.2
Kimi K2.7 Code
74.0
LiveBench · Data Analysis
Qwen3.7 Max leads by +9.1
GPT-5.1-Codex-Max
54.9
Qwen3.7 Max
71.8
Kimi K2.7 Code
62.7
LiveBench · If
Qwen3.7 Max leads by +6.9
GPT-5.1-Codex-Max
67.1
Qwen3.7 Max
74.0
Kimi K2.7 Code
56.3
LiveBench · Language
Qwen3.7 Max leads by +1.8
GPT-5.1-Codex-Max
75.4
Qwen3.7 Max
79.7
Kimi K2.7 Code
77.9
LiveBench · Mathematics
Qwen3.7 Max leads by +1.6
GPT-5.1-Codex-Max
83.7
Qwen3.7 Max
85.3
Kimi K2.7 Code
79.6
LiveBench · Overall
Qwen3.7 Max leads by +2.3
GPT-5.1-Codex-Max
72.0
Qwen3.7 Max
74.3
Kimi K2.7 Code
71.9
LiveBench · Reasoning
GPT-5.1-Codex-Max leads by +1.2
GPT-5.1-Codex-Max
84.6
Qwen3.7 Max
83.3
Kimi K2.7 Code
82.8
Artificial Analysis · Agentic Index
Qwen3.7 Max leads by +1.0
Artificial Analysis Agentic Index · a composite score measuring how well a model performs in agentic workflows · multi-step tool use, planning, error recovery, and autonomous task completion. Aggregates results from multiple agentic benchmarks including SWE-bench, tool-use tests, and planning evaluations. The canonical single-number metric for "how good is this model as an agent?"
Qwen3.7 Max
30.6
Kimi K2.7 Code
29.6
Artificial Analysis · Coding Index
Qwen3.7 Max leads by +5.2
Artificial Analysis Coding Index · a composite score that aggregates performance across multiple coding benchmarks into a single index. Tracks code generation quality, debugging ability, multi-language competence, and real-world software engineering tasks. Used by Artificial Analysis to rank model coding capability in a normalized, comparable format. Useful for developers choosing between models for coding-heavy workloads.
Qwen3.7 Max
66.0
Kimi K2.7 Code
60.8
Artificial Analysis · Quality Index
Qwen3.7 Max leads by +4.0
Qwen3.7 Max
46.0
Kimi K2.7 Code
42.0
Chess Puzzles
Qwen3.7 Max leads by +1.0
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
Qwen3.7 Max
22.0
Kimi K2.7 Code
21.0
FrontierMath-Tier-4-v2-Private
Qwen3.7 Max leads by +21.9
Qwen3.7 Max
34.1
Kimi K2.7 Code
12.2
FrontierMath-Tiers-1-3-v2-Private
Qwen3.7 Max leads by +10.5
Qwen3.7 Max
64.6
Kimi K2.7 Code
54.0
GPQA diamond
Qwen3.7 Max leads by +2.8
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
Qwen3.7 Max
88.8
Kimi K2.7 Code
86.0
OTIS Mock AIME 2024-2025
Kimi K2.7 Code leads by +1.4
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Qwen3.7 Max
95.0
Kimi K2.7 Code
96.4
SimpleQA Verified
Qwen3.7 Max leads by +19.3
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
Qwen3.7 Max
58.5
Kimi K2.7 Code
39.2
Full benchmark table
| Benchmark | GPT-5.1-Codex-Max | Qwen3.7 Max | Kimi K2.7 Code |
|---|---|---|---|
LiveBench · Agentic Coding | 56.7 | 51.7 | 70.0 |
LiveBench · Coding | 81.4 | 74.2 | 74.0 |
LiveBench · Data Analysis | 54.9 | 71.8 | 62.7 |
LiveBench · If | 67.1 | 74.0 | 56.3 |
LiveBench · Language | 75.4 | 79.7 | 77.9 |
LiveBench · Mathematics | 83.7 | 85.3 | 79.6 |
LiveBench · Overall | 72.0 | 74.3 | 71.9 |
LiveBench · Reasoning | 84.6 | 83.3 | 82.8 |
Artificial Analysis · Agentic Index Artificial Analysis Agentic Index · a composite score measuring how well a model performs in agentic workflows · multi-step tool use, planning, error recovery, and autonomous task completion. Aggregates results from multiple agentic benchmarks including SWE-bench, tool-use tests, and planning evaluations. The canonical single-number metric for "how good is this model as an agent?" | — | 30.6 | 29.6 |
Artificial Analysis · Coding Index Artificial Analysis Coding Index · a composite score that aggregates performance across multiple coding benchmarks into a single index. Tracks code generation quality, debugging ability, multi-language competence, and real-world software engineering tasks. Used by Artificial Analysis to rank model coding capability in a normalized, comparable format. Useful for developers choosing between models for coding-heavy workloads. | — | 66.0 | 60.8 |
Artificial Analysis · Quality Index | — | 46.0 | 42.0 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | — | 22.0 | 21.0 |
FrontierMath-Tier-4-v2-Private | — | 34.1 | 12.2 |
FrontierMath-Tiers-1-3-v2-Private | — | 64.6 | 54.0 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | — | 88.8 | 86.0 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | — | 95.0 | 96.4 |
SimpleQA Verified SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. | — | 58.5 | 39.2 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $1.25 | $10.00 | 400K tokens (~200 books) | $34.38 | |
| $1.25 | $3.75 | 1.0M tokens (~500 books) | $18.75 | |
| $0.61 | $3.07 | 262K tokens (~131 books) | $12.26 |