Beta
Classement/Claude 3.5 Sonnet
Anthropic

Claude 3.5 Sonnet

par Anthropic · Sorti le 2024-10-22

28.8
score moyen
$6.00/1M
Prix d'entrée
$30.00/1M
Prix de sortie
200K tokens (~100 books)
Fenêtre de contexte
multimodal
Type

Tested on 10 benchmarks with 28.8% average. Top scores: MMLU (82.0%), MATH level 5 (51.7%), VideoMME (46.7%).

Scores de benchmark

BenchmarkCatégorieScoreBar
MMLUknowledge82.0
MATH level 5math51.7
VideoMMEmultimodal46.7
GPQA diamondknowledge38.7
WeirdMLcoding31.0
Cybenchcoding17.5
SimpleBenchreasoning13.0
OTIS Mock AIME 2024-2025math6.4
FrontierMath-2025-02-28-Privatemath1.0
FrontierMath-Tier-4-2025-07-01-Privatemath0.1

Modèles similaires

MetaLlama 3.1 8B Instruct
Meta
28.7
AnthropicClaude 3 Haiku
Anthropic
28.7
OpenAIGPT-4o (2024-11-20)
OpenAI
28.6
MetaLlama 3.3 70B Instruct (free)
Meta
29.1

Anthropic Claude Sonnet Chronologie

Claude 3 Sonnet
28.3
N/AN/Actx6 benchmarks
Claude 3.5 Sonnet
28.8+0.5
$6.00/M in200Kctx10 benchmarks
Claude 3.7 Sonnet
42.1+13.3
$3.00/M in(-3)200Kctx20 benchmarks
Claude 3.7 Sonnet (thinking)
42.1
$3.00/M in200Kctx20 benchmarks
Claude Sonnet 4
36.9-5.2
$3.00/M in200Kctx20 benchmarks
Claude Sonnet 4.5
40.6+3.7
$3.00/M in1.0Mctx(+800K)18 benchmarks
Claude Sonnet 4.6
47.3+6.7
$3.00/M in1.0Mctx8 benchmarks