Compare · ModelsLive · 2 picked · head to head
Vicuna 7b V1.5 vs Gemma 2 2b
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Vicuna 7b V1.5 wins on 3/6 benchmarks
Vicuna 7b V1.5 wins 3 of 6 shared benchmarks. Leads in general · language · reasoning.
Category leads
general·Vicuna 7b V1.5knowledge·Gemma 2 2blanguage·Vicuna 7b V1.5math·Gemma 2 2breasoning·Vicuna 7b V1.5
Hype vs Reality
Attention vs performance
Vicuna 7b V1.5
#226 by perf·no signal
Gemma 2 2b
#228 by perf·no signal
Vendor risk
Who is behind the model
L
LMSYS
private · undisclosed
Google DeepMind
$4.00T·Tier 1
Head to head
6 benchmarks · 2 models
Vicuna 7b V1.5Gemma 2 2b
BBH (HuggingFace)
Vicuna 7b V1.5 leads by +2.7
Vicuna 7b V1.5
15.2
Gemma 2 2b
12.5
GPQA
Gemma 2 2b leads by +0.6
Vicuna 7b V1.5
1.1
Gemma 2 2b
1.7
IFEval
Vicuna 7b V1.5 leads by +3.3
Vicuna 7b V1.5
23.5
Gemma 2 2b
20.2
MATH Level 5
Gemma 2 2b leads by +1.7
Vicuna 7b V1.5
1.4
Gemma 2 2b
3.0
MMLU-PRO
Gemma 2 2b leads by +0.8
Vicuna 7b V1.5
12.7
Gemma 2 2b
13.5
MUSR
Vicuna 7b V1.5 leads by +0.2
Vicuna 7b V1.5
11.4
Gemma 2 2b
11.3
Full benchmark table
| Benchmark | Vicuna 7b V1.5 | Gemma 2 2b |
|---|---|---|
BBH (HuggingFace) | 15.2 | 12.5 |
GPQA | 1.1 | 1.7 |
IFEval | 23.5 | 20.2 |
MATH Level 5 | 1.4 | 3.0 |
MMLU-PRO | 12.7 | 13.5 |
MUSR | 11.4 | 11.3 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
L Vicuna 7b V1.5 | — | — | — | — |
| Gemma 2 2b | — | — | — | — |