Compare · ModelsLive · 2 picked · head to head
Gemini 2.5 Flash vs Mistral Large 2411
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Gemini 2.5 Flash wins on 7/8 benchmarks
Gemini 2.5 Flash wins 7 of 8 shared benchmarks. Leads in arena · math · language.
Category leads
arena·Gemini 2.5 Flashmath·Gemini 2.5 Flashknowledge·Mistral Large 2411language·Gemini 2.5 Flashreasoning·Gemini 2.5 Flash
Hype vs Reality
Attention vs performance
Gemini 2.5 Flash
#144 by perf·#14 by attention
Mistral Large 2411
#112 by perf·no signal
Best value
Gemini 2.5 Flash
2.5x better value than Mistral Large 2411
Gemini 2.5 Flash
28.6 pts/$
$1.40/M
Mistral Large 2411
11.4 pts/$
$4.00/M
Vendor risk
Who is behind the model
Google DeepMind
$4.00T·Tier 1
Mistral AI
$14.0B·Tier 1
Head to head
8 benchmarks · 2 models
Gemini 2.5 FlashMistral Large 2411
Chatbot Arena Elo · Overall
Gemini 2.5 Flash leads by +106.4
Gemini 2.5 Flash
1411.0
Mistral Large 2411
1304.7
FrontierMath-2025-02-28-Private
Gemini 2.5 Flash leads by +4.5
FrontierMath (Feb 2025) · original research-level math problems created by mathematicians, testing capabilities at the boundary of current AI mathematical reasoning.
Gemini 2.5 Flash
4.8
Mistral Large 2411
0.3
HELM · GPQA
Mistral Large 2411 leads by +4.5
Gemini 2.5 Flash
39.0
Mistral Large 2411
43.5
HELM · IFEval
Gemini 2.5 Flash leads by +2.2
Gemini 2.5 Flash
89.8
Mistral Large 2411
87.6
HELM · MMLU-Pro
Gemini 2.5 Flash leads by +4.0
Gemini 2.5 Flash
63.9
Mistral Large 2411
59.9
HELM · Omni-MATH
Gemini 2.5 Flash leads by +10.3
Gemini 2.5 Flash
38.4
Mistral Large 2411
28.1
HELM · WildBench
Gemini 2.5 Flash leads by +1.6
Gemini 2.5 Flash
81.7
Mistral Large 2411
80.1
OTIS Mock AIME 2024-2025
Gemini 2.5 Flash leads by +65.3
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
Gemini 2.5 Flash
73.0
Mistral Large 2411
7.7
Full benchmark table
| Benchmark | Gemini 2.5 Flash | Mistral Large 2411 |
|---|---|---|
Chatbot Arena Elo · Overall | 1411.0 | 1304.7 |
FrontierMath-2025-02-28-Private FrontierMath (Feb 2025) · original research-level math problems created by mathematicians, testing capabilities at the boundary of current AI mathematical reasoning. | 4.8 | 0.3 |
HELM · GPQA | 39.0 | 43.5 |
HELM · IFEval | 89.8 | 87.6 |
HELM · MMLU-Pro | 63.9 | 59.9 |
HELM · Omni-MATH | 38.4 | 28.1 |
HELM · WildBench | 81.7 | 80.1 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 73.0 | 7.7 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.30 | $2.50 | 1.0M tokens (~524 books) | $8.50 | |
| $2.00 | $6.00 | 131K tokens (~66 books) | $30.00 |