Compare · ModelsLive · 2 picked · head to head
Claude 3.5 Sonnet vs gpt-oss-20b
Side by side · benchmarks, pricing, and signals you can act on.
Winner summary
Claude 3.5 Sonnet wins on 4/6 benchmarks
Claude 3.5 Sonnet wins 4 of 6 shared benchmarks. Leads in arena · language · reasoning.
Category leads
arena·Claude 3.5 Sonnetknowledge·gpt-oss-20blanguage·Claude 3.5 Sonnetmath·gpt-oss-20breasoning·Claude 3.5 Sonnet
Hype vs Reality
Attention vs performance
Claude 3.5 Sonnet
#129 by perf·no signal
gpt-oss-20b
#24 by perf·no signal
Vendor risk
Who is behind the model
Anthropic
$380.0B·Tier 1
OpenAI
$840.0B·Tier 1
Head to head
6 benchmarks · 2 models
Claude 3.5 Sonnetgpt-oss-20b
Chatbot Arena Elo · Overall
Claude 3.5 Sonnet leads by +53.7
Claude 3.5 Sonnet
1371.4
gpt-oss-20b
1317.7
HELM · GPQA
gpt-oss-20b leads by +2.9
Claude 3.5 Sonnet
56.5
gpt-oss-20b
59.4
HELM · IFEval
Claude 3.5 Sonnet leads by +12.4
Claude 3.5 Sonnet
85.6
gpt-oss-20b
73.2
HELM · MMLU-Pro
Claude 3.5 Sonnet leads by +3.7
Claude 3.5 Sonnet
77.7
gpt-oss-20b
74.0
HELM · Omni-MATH
gpt-oss-20b leads by +28.9
Claude 3.5 Sonnet
27.6
gpt-oss-20b
56.5
HELM · WildBench
Claude 3.5 Sonnet leads by +5.5
Claude 3.5 Sonnet
79.2
gpt-oss-20b
73.7
Full benchmark table
| Benchmark | Claude 3.5 Sonnet | gpt-oss-20b |
|---|---|---|
Chatbot Arena Elo · Overall | 1371.4 | 1317.7 |
HELM · GPQA | 56.5 | 59.4 |
HELM · IFEval | 85.6 | 73.2 |
HELM · MMLU-Pro | 77.7 | 74.0 |
HELM · Omni-MATH | 27.6 | 56.5 |
HELM · WildBench | 79.2 | 73.7 |
Pricing · per 1M tokens · projected $/mo at 10M tokens
| Model | Input | Output | Context | Projected $/mo |
|---|---|---|---|---|
| — | — | — | — | |
| $0.03 | $0.14 | 131K tokens (~66 books) | $0.57 |