Beta
Classement/Llama 3.3 70B Instruct (free)
Meta

Llama 3.3 70B Instruct (free)

Code source ouvert

par Meta · Sorti le 2024-12-06

29.1
score moyen
N/A
Prix d'entrée
N/A
Prix de sortie
66K tokens (~33 books)
Fenêtre de contexte
text
Type

Tested on 8 benchmarks with 29.1% average. Top scores: MMLU (81.7%), MATH level 5 (41.6%), Fiction.LiveBench (33.3%).

Scores de benchmark

BenchmarkCatégorieScoreBar
MMLUknowledge81.7
MATH level 5math41.6
Fiction.LiveBenchknowledge33.3
GPQA diamondknowledge29.9
Balrogknowledge23.0
WeirdMLcoding14.4
OTIS Mock AIME 2024-2025math5.0
SimpleBenchreasoning3.9

Modèles similaires

MetaLlama 3.3 70B Instruct
Meta
29.1
U
Dolly 2.0-12b
unknown
29.2
AnthropicClaude 3.5 Sonnet
Anthropic
28.8
MetaLlama 3.1 8B Instruct
Meta
28.7

Meta Llama 3.3 Chronologie

Llama 3.3 70B Instruct
29.1
$0.10/M in131Kctx8 benchmarks
Llama 3.3 70B Instruct (free)
29.1
$0.00/M in(-0.10)66Kctx(-66K)8 benchmarks