Beta
Compare · ModelsLive · 2 picked · head to head

DeepSeek R1 Distill Qwen 7B vs Hermes 2 Pro - Llama-3 8B

Side by side · benchmarks, pricing, and signals you can act on.

Winner summary

Hermes 2 Pro - Llama-3 8B wins 5 of 6 shared benchmarks. Leads in general · knowledge · language.

Category leads
general·Hermes 2 Pro - Llama-3 8Bknowledge·Hermes 2 Pro - Llama-3 8Blanguage·Hermes 2 Pro - Llama-3 8Bmath·DeepSeek R1 Distill Qwen 7Breasoning·Hermes 2 Pro - Llama-3 8B
Hype vs Reality
DeepSeek R1 Distill Qwen 7B
#176 by perf·no signal
QUIET
Hermes 2 Pro - Llama-3 8B
#209 by perf·no signal
QUIET
Best value
DeepSeek R1 Distill Qwen 7B
no price
Hermes 2 Pro - Llama-3 8B
157.9 pts/$
$0.14/M
Vendor risk
One or more vendors flagged
DeepSeek logo
DeepSeek
$3.4B·Tier 1
Higher risk
nousresearch logo
nousresearch
private · undisclosed
Unknown
Head to head
DeepSeek R1 Distill Qwen 7BHermes 2 Pro - Llama-3 8B
BBH (HuggingFace)
Hermes 2 Pro - Llama-3 8B leads by +22.8
DeepSeek R1 Distill Qwen 7B
7.9
Hermes 2 Pro - Llama-3 8B
30.7
GPQA
Hermes 2 Pro - Llama-3 8B leads by +1.8
DeepSeek R1 Distill Qwen 7B
3.9
Hermes 2 Pro - Llama-3 8B
5.7
IFEval
Hermes 2 Pro - Llama-3 8B leads by +13.2
DeepSeek R1 Distill Qwen 7B
40.4
Hermes 2 Pro - Llama-3 8B
53.6
MATH Level 5
DeepSeek R1 Distill Qwen 7B leads by +11.2
DeepSeek R1 Distill Qwen 7B
19.6
Hermes 2 Pro - Llama-3 8B
8.4
MMLU-PRO
Hermes 2 Pro - Llama-3 8B leads by +8.1
DeepSeek R1 Distill Qwen 7B
14.7
Hermes 2 Pro - Llama-3 8B
22.8
MUSR
Hermes 2 Pro - Llama-3 8B leads by +7.7
DeepSeek R1 Distill Qwen 7B
3.5
Hermes 2 Pro - Llama-3 8B
11.3
Full benchmark table
BenchmarkDeepSeek R1 Distill Qwen 7BHermes 2 Pro - Llama-3 8B
BBH (HuggingFace)
7.930.7
GPQA
3.95.7
IFEval
40.453.6
MATH Level 5
19.68.4
MMLU-PRO
14.722.8
MUSR
3.511.3
Pricing · per 1M tokens · projected $/mo at 10M tokens
ModelInputOutputContextProjected $/mo
DeepSeek logoDeepSeek R1 Distill Qwen 7B
nousresearch logoHermes 2 Pro - Llama-3 8B$0.14$0.148K tokens (~4 books)$1.40