Better than 0% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text-generation
License
Open Source
Benchmarks
6 tested
Data updated today
About
TinyLlama text generation model. 2796K downloads on HuggingFace.
Tested on 6 benchmarks with 2.8% average. Top scores: IFEval (6.0%), MUSR (4.3%), BBH (HuggingFace) (4.0%).
Capabilities
reasoning
4.3
#163 globally
math
1.5
#209 globally
knowledge
0.6
#231 globally
language
6.0
#152 globally
general
4.0
#64 globally
Benchmark Scores
Compare AllTested on 6 benchmarks · Ranked across 5 categories
Score Distribution (all 231 models)
0255075100
▲ You are here
reasoningCompare reasoning →
MUSR
4.3—HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.
mathCompare math →
MATH Level 5
1.5—HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.
knowledgeCompare knowledge →
MMLU-PRO
1.1—HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.
GPQA
0.0—HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.
vs DeepSeek Coder 1.3B
vs Gpt Neo 125m
vs Qwen VL Max Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Info
Research
Documentation
Community
Source Code
BenchGecko API
tinyllama-tinyllama-11b-chat-v10
Specifications
- Typetext-generation
- ContextN/A
- ReleasedDec 2023
- LicenseOpen Source
- StatusActive
Available On
T
TinyLlamaTBDLearn More
Share & Export
Frequently Asked Questions
TinyLlama 1.1B Chat V1.0 is an open-source text-generation AI model by TinyLlama, released in December 2023. It has an average benchmark score of 3.8.