Better than 36% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text-generation
License
Open Source
Benchmarks
11 tested
Data updated today
About
Deepseek-ai text generation model. 1145K downloads on HuggingFace.
Tested on 11 benchmarks with 33.6% average. Top scores: JSQuAD (80.2%), JNLI (69.4%), JCommonsenseQA (62.4%).
Capabilities
reasoning
0.5
#182 globally
math
22.0
#153 globally
knowledge
6.4
#215 globally
language
54.8
#99 globally
general
5.3
#60 globally
Benchmark Scores
Compare AllTested on 11 benchmarks · Ranked across 5 categories
Score Distribution (all 231 models)
0255075100
▲ You are here
reasoningCompare reasoning →
MUSR
0.5—HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.
mathCompare math →
MATH Level 5
22.0—HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.
knowledgeCompare knowledge →
MMLU-PRO
12.1—HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.
GPQA
0.7—HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.
vs Claude 3 Opus
vs Command R+ (08-2024) Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Info
Research
Documentation
Community
Source Code
BenchGecko API
deepseek-ai-deepseek-r1-distill-llama-8b
Specifications
- Typetext-generation
- ContextN/A
- ReleasedJan 2025
- LicenseOpen Source
- StatusActive
Available On
DeepSeekTBDLearn More
Share & Export
Frequently Asked Questions
DeepSeek R1 Distill Llama 8B is an open-source text-generation AI model by DeepSeek, released in January 2025. It has an average benchmark score of 38.4.