Compare · ModelsLive · 2 picked · head to head
Phi 3.5 Mini Instruct vs Magnum v4 72B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Phi 3.5 Mini Instruct wins on 4/6 benchmarks
Phi 3.5 Mini Instruct wins 4 of 6 shared benchmarks. Leads in general · knowledge · language.
Category leads
general·Phi 3.5 Mini Instructknowledge·Phi 3.5 Mini Instructlanguage·Phi 3.5 Mini Instructmath·Magnum v4 72Breasoning·Magnum v4 72B
Hype vs Reality
Attention vs performance
Phi 3.5 Mini Instruct
#229 by perf·no signal
Magnum v4 72B
#231 by perf·no signal
Vendor risk
Who is behind the model
Microsoft
$3.00T·Big Tech
anthracite-org
private · undisclosed
Head to head
6 benchmarks · 2 models
Phi 3.5 Mini InstructMagnum v4 72B
BBH (HuggingFace)
Phi 3.5 Mini Instruct leads by +1.2
Phi 3.5 Mini Instruct
36.8
Magnum v4 72B
35.5
GPQA
Phi 3.5 Mini Instruct leads by +1.6
Phi 3.5 Mini Instruct
12.0
Magnum v4 72B
10.4
IFEval
Phi 3.5 Mini Instruct leads by +1.5
Phi 3.5 Mini Instruct
57.8
Magnum v4 72B
56.3
MATH Level 5
Magnum v4 72B leads by +0.4
Phi 3.5 Mini Instruct
19.6
Magnum v4 72B
20.0
MMLU-PRO
Phi 3.5 Mini Instruct leads by +1.5
Phi 3.5 Mini Instruct
32.9
Magnum v4 72B
31.4
MUSR
Magnum v4 72B leads by +3.3
Phi 3.5 Mini Instruct
10.1
Magnum v4 72B
13.4
Full benchmark table
| Benchmark | Phi 3.5 Mini Instruct | Magnum v4 72B |
|---|---|---|
BBH (HuggingFace) | 36.8 | 35.5 |
GPQA | 12.0 | 10.4 |
IFEval | 57.8 | 56.3 |
MATH Level 5 | 19.6 | 20.0 |
MMLU-PRO | 32.9 | 31.4 |
MUSR | 10.1 | 13.4 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| — | — | — | — | |
| $3.00 | $5.00 | 33K tokens (~16 books) | $35.00 |