Compare · ModelsLive · 2 picked · head to head
Hermes 2 Pro - Llama-3 8B vs DeepSeek R1 Distill Qwen 7B
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Hermes 2 Pro - Llama-3 8B wins on 5/6 benchmarks
Hermes 2 Pro - Llama-3 8B wins 5 of 6 shared benchmarks. Leads in general · knowledge · language.
Category leads
general·Hermes 2 Pro - Llama-3 8Bknowledge·Hermes 2 Pro - Llama-3 8Blanguage·Hermes 2 Pro - Llama-3 8Bmath·DeepSeek R1 Distill Qwen 7Breasoning·Hermes 2 Pro - Llama-3 8B
Hype vs Reality
Attention vs performance
Hermes 2 Pro - Llama-3 8B
#211 by perf·no signal
DeepSeek R1 Distill Qwen 7B
#178 by perf·no signal
Best value
Hermes 2 Pro - Llama-3 8B
Hermes 2 Pro - Llama-3 8B
157.9 pts/$
$0.14/M
DeepSeek R1 Distill Qwen 7B
—
no price
Vendor risk
Mixed exposure
One or more vendors flagged
nousresearch
private · undisclosed
DeepSeek
$3.4B·Tier 1
Head to head
6 benchmarks · 2 models
Hermes 2 Pro - Llama-3 8BDeepSeek R1 Distill Qwen 7B
BBH (HuggingFace)
Hermes 2 Pro - Llama-3 8B leads by +22.8
Hermes 2 Pro - Llama-3 8B
30.7
DeepSeek R1 Distill Qwen 7B
7.9
GPQA
Hermes 2 Pro - Llama-3 8B leads by +1.8
Hermes 2 Pro - Llama-3 8B
5.7
DeepSeek R1 Distill Qwen 7B
3.9
IFEval
Hermes 2 Pro - Llama-3 8B leads by +13.2
Hermes 2 Pro - Llama-3 8B
53.6
DeepSeek R1 Distill Qwen 7B
40.4
MATH Level 5
DeepSeek R1 Distill Qwen 7B leads by +11.2
Hermes 2 Pro - Llama-3 8B
8.4
DeepSeek R1 Distill Qwen 7B
19.6
MMLU-PRO
Hermes 2 Pro - Llama-3 8B leads by +8.1
Hermes 2 Pro - Llama-3 8B
22.8
DeepSeek R1 Distill Qwen 7B
14.7
MUSR
Hermes 2 Pro - Llama-3 8B leads by +7.7
Hermes 2 Pro - Llama-3 8B
11.3
DeepSeek R1 Distill Qwen 7B
3.5
Full benchmark table
| Benchmark | Hermes 2 Pro - Llama-3 8B | DeepSeek R1 Distill Qwen 7B |
|---|---|---|
BBH (HuggingFace) | 30.7 | 7.9 |
GPQA | 5.7 | 3.9 |
IFEval | 53.6 | 40.4 |
MATH Level 5 | 8.4 | 19.6 |
MMLU-PRO | 22.8 | 14.7 |
MUSR | 11.3 | 3.5 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| $0.14 | $0.14 | 8K tokens (~4 books) | $1.40 | |
| — | — | — | — |