Beta
Clasificaci贸n/Llama 3.1 8B Instruct
Meta

Llama 3.1 8B Instruct

C贸digo abierto

por Meta 路 Publicado el 2024-07-23

28.7
puntuaci贸n promedio
$0.02/1M
Precio de entrada
$0.05/1M
Precio de salida
16K tokens (~8 books)
Ventana de contexto
text
Tipo

Tested on 8 benchmarks with 28.7% average. Top scores: GSM8K (82.4%), PIQA (62.4%), MMLU (41.5%).

Puntuaciones de benchmark

BenchmarkCategor铆aPuntuaci贸nBar
GSM8Kmath82.4
PIQAknowledge62.4
MMLUknowledge41.5
MATH level 5math22.9
Balrogknowledge15.1
OTIS Mock AIME 2024-2025math2.4
WeirdMLcoding1.7
GPQA diamondknowledge1.3

Modelos similares

AnthropicClaude 3 Haiku
Anthropic
28.7
OpenAIGPT-4o (2024-11-20)
OpenAI
28.6
AnthropicClaude 3.5 Sonnet
Anthropic
28.8
AnthropicClaude 3 Sonnet
Anthropic
28.3

Meta Llama 3.1 Cronolog铆a

Llama 3.1 70B Instruct
26.1
$0.40/M in131Kctx7 benchmarks
Llama 3.1 8B Instruct
28.7+2.6
$0.02/M in(-0.38)16Kctx(-115K)8 benchmarks
Llama 3.1-405B
49.3+20.6
N/AN/Actx15 benchmarks