Home/Models/Llama 3.2 3B Instruct (free)
Meta logo

Llama 3.2 3B Instruct (free)

by Meta · Released Sep 2024

Open Source
14.7
avg score
Rank #216
Compare
Better than 7% of all models
Context
131K tokens (~66 books)
Input $/1M
Free
Output $/1M
Free
Type
text
License
Open Source
Benchmarks
6 tested
Data updated today
About

Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it...

Tested on 6 benchmarks with 8.7% average. Top scores: MMLU-PRO (16.5%), BBH (HuggingFace) (14.2%), IFEval (13.4%).

Capabilities
reasoning
3.8
#166 globally
math
1.9
#205 globally
knowledge
9.4
#211 globally
language
13.4
#150 globally
general
14.2
#47 globally
Benchmark Scores
Compare All
Tested on 6 benchmarks · Ranked across 5 categories
Score Distribution (all 233 models)
0255075100
▲ You are here
MUSR

HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.

3.8
MATH Level 5

HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.

1.9
MMLU-PRO

HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.

16.5
GPQA

HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.

2.4
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Documentation
Community
BenchGecko API
llama-3-2-3b-instruct-free
Specifications
  • Typetext
  • Context131K tokens (~66 books)
  • ReleasedSep 2024
  • LicenseOpen Source
  • StatusActive
  • Cost / Message~$0.000
Available On
Meta logoMetaFree
Share & Export
Tweet
Llama 3.2 3B Instruct (free) is an open-source text AI model by Meta, released in September 2024. It has an average benchmark score of 14.7. Context window: 131K tokens.