Compare · ModelsLive · 2 picked · head to head
o3 Mini vs Qwen3.5-Flash
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Qwen3.5-Flash wins on 4/6 benchmarks
Qwen3.5-Flash wins 4 of 6 shared benchmarks. Leads in arena · knowledge.
Category leads
arena·Qwen3.5-Flashknowledge·Qwen3.5-Flashmath·o3 Mini
Hype vs Reality
Attention vs performance
o3 Mini
#197 by perf·no signal
Qwen3.5-Flash
#199 by perf·no signal
Best value
Qwen3.5-Flash
16.8x better value than o3 Mini
o3 Mini
12.8 pts/$
$2.75/M
Qwen3.5-Flash
215.4 pts/$
$0.16/M
Vendor risk
Who is behind the model
OpenAI
$840.0B·Tier 1
Alibaba (Qwen)
$293.0B·Tier 1
Head to head
6 benchmarks · 2 models
o3 MiniQwen3.5-Flash
Chatbot Arena Elo · Overall
Qwen3.5-Flash leads by +49.4
o3 Mini
1347.7
Qwen3.5-Flash
1397.0
Chess Puzzles
Qwen3.5-Flash leads by +3.0
Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities.
o3 Mini
17.0
Qwen3.5-Flash
20.0
FrontierMath-2025-02-28-Private
o3 Mini leads by +6.2
FrontierMath (Feb 2025) · original research-level math problems created by mathematicians, testing capabilities at the boundary of current AI mathematical reasoning.
o3 Mini
12.4
Qwen3.5-Flash
6.2
FrontierMath-Tier-4-2025-07-01-Private
o3 Mini leads by +4.2
FrontierMath Tier 4 (Jul 2025) · the most challenging tier of frontier mathematics, containing problems that push the absolute limits of AI mathematical reasoning.
o3 Mini
4.2
Qwen3.5-Flash
0.0
GPQA diamond
Qwen3.5-Flash leads by +9.1
Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs.
o3 Mini
69.4
Qwen3.5-Flash
78.5
OTIS Mock AIME 2024-2025
Qwen3.5-Flash leads by +8.6
OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.
o3 Mini
76.9
Qwen3.5-Flash
85.5
Full benchmark table
| Benchmark | o3 Mini | Qwen3.5-Flash |
|---|---|---|
Chatbot Arena Elo · Overall | 1347.7 | 1397.0 |
Chess Puzzles Chess Puzzles · tests strategic and tactical reasoning by having models solve chess puzzle positions, evaluating lookahead and pattern recognition abilities. | 17.0 | 20.0 |
FrontierMath-2025-02-28-Private FrontierMath (Feb 2025) · original research-level math problems created by mathematicians, testing capabilities at the boundary of current AI mathematical reasoning. | 12.4 | 6.2 |
FrontierMath-Tier-4-2025-07-01-Private FrontierMath Tier 4 (Jul 2025) · the most challenging tier of frontier mathematics, containing problems that push the absolute limits of AI mathematical reasoning. | 4.2 | 0.0 |
GPQA diamond Graduate-Level Google-Proof QA (Diamond set) · expert-crafted questions in physics, biology, and chemistry that are difficult even for domain PhDs. | 69.4 | 78.5 |
OTIS Mock AIME 2024-2025 OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills. | 76.9 | 85.5 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $1.10 | $4.40 | 200K tokens (~100 books) | $19.25 | |
| $0.07 | $0.26 | 1.0M tokens (~500 books) | $1.14 |
People also compared