Llama 3.1 8B Instruct
Open Sourceby Meta 路 Released 2024-07-23
28.7
avg score
$0.02/1M
Input Price
$0.05/1M
Output Price
16K tokens (~8 books)
Context Window
text
Type
Tested on 8 benchmarks with 28.7% average. Top scores: GSM8K (82.4%), PIQA (62.4%), MMLU (41.5%).
Benchmark Scores
| Benchmark | Category | Score | Bar |
|---|---|---|---|
| GSM8K | math | 82.4 | |
| PIQA | knowledge | 62.4 | |
| MMLU | knowledge | 41.5 | |
| MATH level 5 | math | 22.9 | |
| Balrog | knowledge | 15.1 | |
| OTIS Mock AIME 2024-2025 | math | 2.4 | |
| WeirdML | coding | 1.7 | |
| GPQA diamond | knowledge | 1.3 |