Home/Models/Llama 3.2 1B Instruct
Meta logo

Llama 3.2 1B Instruct

by Meta · Released Sep 2024

Open Source
19.9
avg score
Rank #205
Compare
Better than 12% of all models
Context
60K tokens (~30 books)
Input $/1M
$0.03
Output $/1M
$0.20
Type
text
License
Open Source
Benchmarks
7 tested
Data updated today
About

Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows it to operate...

Tested on 7 benchmarks with 14.5% average. Top scores: Chatbot Arena Elo — Overall (1110.2%), IFEval (58.1%), BBH (HuggingFace) (8.3%).

Capabilities
reasoning
1.9
#178 globally
math
8.2
#192 globally
knowledge
5.3
#219 globally
general
8.3
#51 globally
language
58.1
#90 globally
Benchmark Scores
Compare All
Tested on 7 benchmarks · Ranked across 6 categories
Score Distribution (all 233 models)
0255075100
▲ You are here
MUSR

HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.

1.9
MATH Level 5

HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.

8.2
MMLU-PRO

HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.

8.2
GPQA

HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.

2.4
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Documentation
Community
BenchGecko API
llama-3-2-1b-instruct
Specifications
  • Typetext
  • Context60K tokens (~30 books)
  • ReleasedSep 2024
  • LicenseOpen Source
  • StatusActive
  • Cost / Message~$0.000
Available On
Meta logoMeta$0.03
Share & Export
Tweet
Llama 3.2 1B Instruct is an open-source text AI model by Meta, released in September 2024. It has an average benchmark score of 19.9. Context window: 60K tokens.