Leaderboard/GPT-4o (2024-05-13)

GPT-4o (2024-05-13)

by OpenAI · Released 2024-05-13

31.6

avg score

$5.00/1M

Input Price

$15.00/1M

Output Price

128K tokens (~64 books)

Context Window

multimodal

Type

Tested on 9 benchmarks with 31.6% average. Top scores: MMLU (79.1%), VideoMME (62.5%), MATH level 5 (53.3%).

Benchmark Scores

Benchmark	Category	Score
MMLU	knowledge	79.1
VideoMME	multimodal	62.5
MATH level 5	math	53.3
GPQA diamond	knowledge	32.3
CadEval	coding	26.0
Aider polyglot	coding	23.1
OTIS Mock AIME 2024-2025	math	6.3
SimpleBench	reasoning	1.4
FrontierMath-2025-02-28-Private	math	0.3

Similar Models

Qwen3 Coder 480B A35B (free)

Alibaba Qwen

31.7

OpenAI GPT-4o Timeline

GPT-4o

31.6

$2.50/M in128Kctx9 benchmarks

GPT-4o (2024-05-13)

31.6

$5.00/M in(+2.50)128Kctx9 benchmarks

GPT-4o (2024-08-06)

31.6

$2.50/M in(-2.50)128Kctx9 benchmarks

GPT-4o (2024-11-20)

28.6-3.0

$2.50/M in128Kctx17 benchmarks

GPT-4o (extended)

31.6+3.0

$6.00/M in(+3.50)128Kctx9 benchmarks

GPT-4o Audio

$2.50/M in(-3.50)128Kctx

GPT-4o Search Preview

$2.50/M in128Kctx

GPT-4o-mini

38.5+38.5

$0.15/M in(-2.35)128Kctx14 benchmarks

GPT-4o-mini (2024-07-18)

38.5

$0.15/M in128Kctx14 benchmarks

GPT-4o-mini Search Preview

$0.15/M in128Kctx