Compare · ModelsLive · 2 picked · head to head
Llama 3.2 1B Instruct vs Vicuna 7b V1.5
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Llama 3.2 1B Instruct wins on 3/6 benchmarks
Llama 3.2 1B Instruct wins 3 of 6 shared benchmarks. Leads in knowledge · language · math.
Category leads
general·Vicuna 7b V1.5knowledge·Llama 3.2 1B Instructlanguage·Llama 3.2 1B Instructmath·Llama 3.2 1B Instructreasoning·Vicuna 7b V1.5
Hype vs Reality
Attention vs performance
Llama 3.2 1B Instruct
#223 by perf·no signal
Vicuna 7b V1.5
#228 by perf·no signal
Best value
Llama 3.2 1B Instruct
Llama 3.2 1B Instruct
127.8 pts/$
$0.11/M
Vicuna 7b V1.5
—
no price
Vendor risk
Who is behind the model
Meta AI
$1.50T·Tier 1
L
LMSYS
private · undisclosed
Head to head
6 benchmarks · 2 models
Llama 3.2 1B InstructVicuna 7b V1.5
BBH (HuggingFace)
Vicuna 7b V1.5 leads by +6.8
Llama 3.2 1B Instruct
8.3
Vicuna 7b V1.5
15.2
GPQA
Llama 3.2 1B Instruct leads by +1.2
Llama 3.2 1B Instruct
2.4
Vicuna 7b V1.5
1.1
IFEval
Llama 3.2 1B Instruct leads by +34.6
Llama 3.2 1B Instruct
58.1
Vicuna 7b V1.5
23.5
MATH Level 5
Llama 3.2 1B Instruct leads by +6.9
Llama 3.2 1B Instruct
8.2
Vicuna 7b V1.5
1.4
MMLU-PRO
Vicuna 7b V1.5 leads by +4.5
Llama 3.2 1B Instruct
8.2
Vicuna 7b V1.5
12.7
MUSR
Vicuna 7b V1.5 leads by +9.5
Llama 3.2 1B Instruct
1.9
Vicuna 7b V1.5
11.4
Full benchmark table
| Benchmark | Llama 3.2 1B Instruct | Vicuna 7b V1.5 |
|---|---|---|
BBH (HuggingFace) | 8.3 | 15.2 |
GPQA | 2.4 | 1.1 |
IFEval | 58.1 | 23.5 |
MATH Level 5 | 8.2 | 1.4 |
MMLU-PRO | 8.2 | 12.7 |
MUSR | 1.9 | 11.4 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.03 | $0.20 | 60K tokens (~30 books) | $0.70 | |
L Vicuna 7b V1.5 | — | — | — | — |