Beta
Leaderboard/Claude 3 Sonnet
Anthropic

Claude 3 Sonnet

by Anthropic 路 Released 2024-01-01

28.3
avg score
N/A
Input Price
N/A
Output Price
N/A
Context Window
text
Type

Tested on 6 benchmarks with 28.3% average. Top scores: MMLU (67.9%), Winogrande (50.2%), GPQA diamond (20.8%).

Benchmark Scores

BenchmarkCategoryScoreBar
MMLUknowledge67.9
Winograndeknowledge50.2
GPQA diamondknowledge20.8
MATH level 5math18.2
WeirdMLcoding10.2
OTIS Mock AIME 2024-2025math2.4

Similar Models

MetaLlama 4 Maverick
Meta
28.0
OpenAIGPT-4o (2024-11-20)
OpenAI
28.6
Google DeepMindGemma 2 27B
Google DeepMind
28.0
MetaLlama 3.1 8B Instruct
Meta
28.7

Anthropic Claude Sonnet Timeline

Claude 3 Sonnet
28.3
N/AN/Actx6 benchmarks
Claude 3.5 Sonnet
28.8+0.5
$6.00/M in200Kctx10 benchmarks
Claude 3.7 Sonnet
42.1+13.3
$3.00/M in(-3)200Kctx20 benchmarks
Claude 3.7 Sonnet (thinking)
42.1
$3.00/M in200Kctx20 benchmarks
Claude Sonnet 4
36.9-5.2
$3.00/M in200Kctx20 benchmarks
Claude Sonnet 4.5
40.6+3.7
$3.00/M in1.0Mctx(+800K)18 benchmarks
Claude Sonnet 4.6
47.3+6.7
$3.00/M in1.0Mctx8 benchmarks