Compare · ModelsLive · 2 picked · head to head
GPT-5 Chat vs Mistral Small 3.1 24B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
GPT-5 Chat wins on 5/5 benchmarks
GPT-5 Chat wins 5 of 5 shared benchmarks. Leads in knowledge · language · math.
Category leads
knowledge·GPT-5 Chatlanguage·GPT-5 Chatmath·GPT-5 Chatreasoning·GPT-5 Chat
Hype vs Reality
Attention vs performance
GPT-5 Chat
#1 by perf·#1 by attention
Mistral Small 3.1 24B
#65 by perf·no signal
Best value
Mistral Small 3.1 24B
8.4x better value than GPT-5 Chat
GPT-5 Chat
14.6 pts/$
$5.63/M
Mistral Small 3.1 24B
122.6 pts/$
$0.46/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
Mistral AI
$14.0B·Tier 1
Head to head
5 benchmarks · 2 models
GPT-5 ChatMistral Small 3.1 24B
HELM · GPQA
GPT-5 Chat leads by +39.9
GPT-5 Chat
79.1
Mistral Small 3.1 24B
39.2
HELM · IFEval
GPT-5 Chat leads by +12.5
GPT-5 Chat
87.5
Mistral Small 3.1 24B
75.0
HELM · MMLU-Pro
GPT-5 Chat leads by +25.3
GPT-5 Chat
86.3
Mistral Small 3.1 24B
61.0
HELM · Omni-MATH
GPT-5 Chat leads by +39.9
GPT-5 Chat
64.7
Mistral Small 3.1 24B
24.8
HELM · WildBench
GPT-5 Chat leads by +6.9
GPT-5 Chat
85.7
Mistral Small 3.1 24B
78.8
Full benchmark table
| Benchmark | GPT-5 Chat | Mistral Small 3.1 24B |
|---|---|---|
HELM · GPQA | 79.1 | 39.2 |
HELM · IFEval | 87.5 | 75.0 |
HELM · MMLU-Pro | 86.3 | 61.0 |
HELM · Omni-MATH | 64.7 | 24.8 |
HELM · WildBench | 85.7 | 78.8 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| GPT-5 Chat | $1.25 | $10.00 | 128K tokens (~64 books) | $34.38 |
| Mistral Small 3.1 24B | $0.35 | $0.56 | 128K tokens (~64 books) | $4.02 |