Compare · ModelsLive · 2 picked · head to head
Mistral 7B Instruct v0.1 vs Vicuna 7b V1.5
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Mistral 7B Instruct v0.1 wins on 3/6 benchmarks
Mistral 7B Instruct v0.1 wins 3 of 6 shared benchmarks. Leads in language · math.
Category leads
general·Vicuna 7b V1.5knowledge·Vicuna 7b V1.5language·Mistral 7B Instruct v0.1math·Mistral 7B Instruct v0.1reasoning·Vicuna 7b V1.5
Hype vs Reality
Attention vs performance
Mistral 7B Instruct v0.1
#227 by perf·no signal
Vicuna 7b V1.5
#228 by perf·no signal
Best value
Mistral 7B Instruct v0.1
Mistral 7B Instruct v0.1
85.3 pts/$
$0.15/M
Vicuna 7b V1.5
—
no price
Vendor risk
Who is behind the model
Mistral AI
$14.0B·Tier 1
L
LMSYS
private · undisclosed
Head to head
6 benchmarks · 2 models
Mistral 7B Instruct v0.1Vicuna 7b V1.5
BBH (HuggingFace)
Vicuna 7b V1.5 leads by +7.5
Mistral 7B Instruct v0.1
7.7
Vicuna 7b V1.5
15.2
GPQA
Vicuna 7b V1.5 leads by +1.1
Mistral 7B Instruct v0.1
0.0
Vicuna 7b V1.5
1.1
IFEval
Mistral 7B Instruct v0.1 leads by +21.3
Mistral 7B Instruct v0.1
44.9
Vicuna 7b V1.5
23.5
MATH Level 5
Mistral 7B Instruct v0.1 leads by +0.9
Mistral 7B Instruct v0.1
2.3
Vicuna 7b V1.5
1.4
MMLU-PRO
Mistral 7B Instruct v0.1 leads by +3.0
Mistral 7B Instruct v0.1
15.7
Vicuna 7b V1.5
12.7
MUSR
Vicuna 7b V1.5 leads by +5.3
Mistral 7B Instruct v0.1
6.1
Vicuna 7b V1.5
11.4
Full benchmark table
| Benchmark | Mistral 7B Instruct v0.1 | Vicuna 7b V1.5 |
|---|---|---|
BBH (HuggingFace) | 7.7 | 15.2 |
GPQA | 0.0 | 1.1 |
IFEval | 44.9 | 23.5 |
MATH Level 5 | 2.3 | 1.4 |
MMLU-PRO | 15.7 | 12.7 |
MUSR | 6.1 | 11.4 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.11 | $0.19 | 3K tokens (~1 books) | $1.30 | |
L Vicuna 7b V1.5 | — | — | — | — |