Compare · ModelsLive · 2 picked · head to head
INTELLECT-1 vs Llama 2 7b Hf
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Llama 2 7b Hf wins on 5/6 benchmarks
Llama 2 7b Hf wins 5 of 6 shared benchmarks. Leads in general · knowledge · language.
Category leads
general·Llama 2 7b Hfknowledge·Llama 2 7b Hflanguage·Llama 2 7b Hfmath·Llama 2 7b Hfreasoning·INTELLECT-1
Hype vs Reality
Attention vs performance
INTELLECT-1
#214 by perf·no signal
Llama 2 7b Hf
#207 by perf·no signal
Vendor risk
Who is behind the model
U
Unknown
private · undisclosed
Meta AI
$1.50T·Tier 1
Head to head
6 benchmarks · 2 models
INTELLECT-1Llama 2 7b Hf
BBH (HuggingFace)
Llama 2 7b Hf leads by +9.3
INTELLECT-1
1.0
Llama 2 7b Hf
10.3
GPQA
Llama 2 7b Hf leads by +2.2
INTELLECT-1
0.0
Llama 2 7b Hf
2.2
IFEval
Llama 2 7b Hf leads by +7.6
INTELLECT-1
17.6
Llama 2 7b Hf
25.2
MATH Level 5
Llama 2 7b Hf leads by +1.7
INTELLECT-1
0.0
Llama 2 7b Hf
1.7
MMLU-PRO
Llama 2 7b Hf leads by +8.2
INTELLECT-1
1.3
Llama 2 7b Hf
9.6
MUSR
INTELLECT-1 leads by +0.4
INTELLECT-1
4.1
Llama 2 7b Hf
3.8
Full benchmark table
| Benchmark | INTELLECT-1 | Llama 2 7b Hf |
|---|---|---|
BBH (HuggingFace) | 1.0 | 10.3 |
GPQA | 0.0 | 2.2 |
IFEval | 17.6 | 25.2 |
MATH Level 5 | 0.0 | 1.7 |
MMLU-PRO | 1.3 | 9.6 |
MUSR | 4.1 | 3.8 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
U INTELLECT-1 | — | — | — | — |
| — | — | — | — |