Beta
Leaderboard/GPT-4o (2024-11-20)
OpenAI

GPT-4o (2024-11-20)

by OpenAI 路 Released 2024-11-20

28.6
avg score
$2.50/1M
Input Price
$10.00/1M
Output Price
128K tokens (~64 books)
Context Window
multimodal
Type

Tested on 17 benchmarks with 28.6% average. Top scores: MMLU (84.1%), Lech Mazur Writing (81.8%), GeoBench (71.0%).

Benchmark Scores

BenchmarkCategoryScoreBar
MMLUknowledge84.1
Lech Mazur Writingknowledge81.8
GeoBenchknowledge71.0
VideoMMEmultimodal62.5
MATH level 5math49.8
GPQA diamondknowledge30.5
WeirdMLcoding25.1
SWE-Bench Verified (Bash Only)coding21.6
Aider polyglotcoding18.2
Cybenchcoding12.5
VPCTknowledge10.0
The Agent Companyagentic8.6
OTIS Mock AIME 2024-2025math6.2
ARC-AGIreasoning4.5
FrontierMath-2025-02-28-Privatemath0.3
GSO-Benchcoding0.1
ARC-AGI-2reasoning0.1

Similar Models

MetaLlama 3.1 8B Instruct
Meta
28.7
AnthropicClaude 3 Haiku
Anthropic
28.7
AnthropicClaude 3.5 Sonnet
Anthropic
28.8
AnthropicClaude 3 Sonnet
Anthropic
28.3

OpenAI GPT-4o Timeline

GPT-4o
31.6
$2.50/M in128Kctx9 benchmarks
GPT-4o (2024-05-13)
31.6
$5.00/M in(+2.50)128Kctx9 benchmarks
GPT-4o (2024-08-06)
31.6
$2.50/M in(-2.50)128Kctx9 benchmarks
GPT-4o (2024-11-20)
28.6-3.0
$2.50/M in128Kctx17 benchmarks
GPT-4o (extended)
31.6+3.0
$6.00/M in(+3.50)128Kctx9 benchmarks
GPT-4o Audio
$2.50/M in(-3.50)128Kctx
GPT-4o Search Preview
$2.50/M in128Kctx
GPT-4o-mini
38.5+38.5
$0.15/M in(-2.35)128Kctx14 benchmarks
GPT-4o-mini (2024-07-18)
38.5
$0.15/M in128Kctx14 benchmarks
GPT-4o-mini Search Preview
$0.15/M in128Kctx