Which model leads on OTIS Mock AIME 2024-2025?

Claude Fable 5 from Anthropic leads OTIS Mock AIME 2024-2025 with a score of 100.0. The median score across 177 tested models is 77.8.

Is OTIS Mock AIME 2024-2025 saturated?

Yes · the top model on OTIS Mock AIME 2024-2025 has reached 100.0 out of 100, within 5% of the theoretical ceiling. This benchmark is approaching saturation and may be replaced by a harder successor.

Does OTIS Mock AIME 2024-2025 predict performance on other benchmarks?

Yes · OTIS Mock AIME 2024-2025 scores correlate 0.96 with GPQA diamond across 173 shared models. Models that do well on OTIS Mock AIME 2024-2025 tend to do well on GPQA diamond.

How often is OTIS Mock AIME 2024-2025 data refreshed?

BenchGecko pulls updates daily. New model scores on OTIS Mock AIME 2024-2025 appear as soon as they are published by Epoch AI or the model provider.

Benchmark · MathSettled

OTIS Mock AIME 2024-2025

Name: OTIS Mock AIME 2024-2025 Benchmark
Creator: BenchGecko
License: https://creativecommons.org/licenses/by/4.0/

OTIS Mock AIME 2024-2025 · simulated American Invitational Mathematics Examination problems testing advanced problem-solving skills.

Updated 2026-11-09

Models tested

177

Top score

100.0

Claude Fable 5

Median

77.8

min 0.5

Top-5 spread

σ 0.0

Settled

The Frontier

Best score over time · one chart, every benchmark

Chart type

Frontier on OTIS Mock AIME 2024-2025 rose from 73.3 to 100.0 in 16 months · +26.7 points · latest leader GPT-5.5 from OpenAI.

Pink dots = frontier records · 12 totalClick to open model page

Full rankings

177 models tested · sorted by score

#	Model	Score	Price
1	Claude Fable 5· Anthropic	100.0	$10.00
2	Claude Fable 5.1· Anthropic	100.0	$10.00
3	GPT-6 Astra· OpenAI	100.0	$10.00
4	GPT-5.5· OpenAI	100.0	$5.00
5	Claude Opus 5.5· Anthropic	100.0	$4.00
6	Kimi K3.1 Pro· moonshotai	100.0	$2.00
7	GPT-6 Sol· OpenAI	100.0	$2.00
8	GPT-6.1 Sol· OpenAI	100.0	$2.00
9	GPT-5.6 Sol· OpenAI	100.0	$4.00
10	Gemini 4 Argon· Google DeepMind	100.0	$2.00
11	GPT-6.1 Terra· OpenAI	100.0	$1.00
12	GPT-5.5 Pro· OpenAI	100.0	$30.00
13	Claude Sonnet 5.5· Anthropic	100.0	$2.00
14	GPT-5.6 Terra· OpenAI	99.7	$2.00
15	Claude Fable 5.2· Anthropic	99.7	$8.00
16	Qwen3.8 Max (0902)· Alibaba Qwen	99.4	$2.00
17	DeepSeek V4.1 Flash 1017· DeepSeek	99.4	$0.01
18	Mistral Large 4· Mistral AI	99.4	$0.70
19	Grok 4.6· xAI	99.2	$2.00
20	Claude Opus 5· Anthropic	98.9	$5.00
21	Gemini 3.8 Flash· Google DeepMind	98.9	$0.82
22	GPT-6 Luna· OpenAI	98.9	$0.10
23	Claude Haiku 5.5· Anthropic	98.9	$0.10
24	DeepSeek V4 Pro 0813· DeepSeek	98.6	$0.11
25	Claude Opus 4.8· Anthropic	98.3	$5.00
26	GPT-5.6 Luna· OpenAI	98.3	$0.20
27	DeepSeek V4.1 Flash· DeepSeek	98.3	$0.05
28	Grok 4.7· xAI	98.0	$2.00
29	Muse Spark Open· Meta	98.0	$1.25
30	Claude Opus 4.7· Anthropic	97.8	$5.00
31	GPT-5.4· OpenAI	97.8	$2.50
32	Grok 4.5· xAI	97.8	$2.00
33	Gemini 3.7 Flash· Google DeepMind	97.2	$0.75
34	Kimi K3· moonshotai	97.2	$0.19
35	DeepSeek V4 Pro· DeepSeek	96.7	$0.88
36	GPT-5.2· OpenAI	96.1	$1.75
37	Kimi K2.6· moonshotai	96.1	$0.65
38	Gemini 3.1 Pro Preview· Google DeepMind	95.6	$2.00
39	Gemini 3.5 Flash· Google DeepMind	95.5	$1.50
40	Kimi K2.7 Code· moonshotai	95.5	$0.60
41	Qwen3.7 Max· Alibaba Qwen	95.5	$1.48
42	Claude Sonnet 5· Anthropic	94.7	$2.00
43	DeepSeek V4 Flash 0731· DeepSeek	94.4	$0.04
44	Claude Opus 4.6· Anthropic	94.4	$5.00
45	Gemini 3.6 Flash· Google DeepMind	94.2	$0.75
46	GLM 5.3 Flash· z-ai	93.9	$0.04
47	Qwen3.6 Plus· Alibaba Qwen	93.3	$0.33
48	Qwen3.7 Plus· Alibaba Qwen	93.3	$0.32
49	GLM 5.1· z-ai	93.3	$1.33
50	Grok 4.3· xAI	93.3	$1.25
51	Gemini 3 Flash Preview· Google DeepMind	92.8	$0.50
52	Grok 4.20· xAI	92.2	$1.25
53	Kimi K2.5· moonshotai	92.2	$0.53
54	Gemini 3 Pro· Google DeepMind	91.4	n/a
55	GPT-5· OpenAI	91.4	$1.25
56	GLM 5.3· z-ai	91.1	$0.07
57	Qwen3.6 Max Preview· Alibaba Qwen	91.1	$1.03
58	Qwen3.6 27B· Alibaba Qwen	91.1	$0.32
59	Muse Spark· Meta	88.9	n/a
60	gpt-oss-120b· OpenAI	88.9	$0.15
61	GPT-5.4 Mini· OpenAI	88.9	$0.75
62	Qwen3.5 397B A17B· Alibaba Qwen	88.9	$0.60
63	GPT-5.1· OpenAI	88.6	$1.25
64	DeepSeek V3.2· DeepSeek	87.8	$0.26
65	GPT-5.4 Nano· OpenAI	87.8	$0.20
66	Qwen3.7 Flash· Alibaba Qwen	86.7	$0.03
67	GPT-5 Mini· OpenAI	86.7	$0.25
68	Nemotron 3 Ultra· NVIDIA	86.7	$0.60
69	Qwen3 235B A22B Thinking 2507· Alibaba Qwen	86.7	$0.45
70	Qwen3.6 35B A3B· Alibaba Qwen	86.7	$0.10
71	Qwen 3.5 Plus (hosted 397B-A17B)· Alibaba Qwen	86.7	n/a
72	GLM 5.2· z-ai	86.4	$0.01
73	Claude Opus 4.5· Anthropic	86.1	$5.00
74	Claude Sonnet 4.6· Anthropic	85.8	$3.00
75	Gemini 2.5 Pro· Google DeepMind	84.7	$1.25
76	Qwen3.6 Flash· Alibaba Qwen	84.4	$0.19
77	Qwen3.5-Flash· Alibaba Qwen	84.4	$0.07
78	o3· OpenAI	84.4	$2.00
79	Grok 4· xAI	84.0	n/a
80	GLM 4.7· z-ai	83.3	$0.60
81	Kimi K2 Thinking· moonshotai	83.0	$0.60
82	Gemma 4 26B A4B · Google DeepMind	82.2	$0.08
83	o4 Mini· OpenAI	81.7	$1.10
84	o4 Mini (batch)· OpenAI	81.7	$0.55
85	GPT-5 Nano· OpenAI	81.1	$0.05
86	Gemini 3.1 Flash Lite· Google DeepMind	80.0	$0.25
87	GLM 5· z-ai	80.0	$1.00
88	Claude Sonnet 4.5· Anthropic	77.8	$3.00
89	Grok-3 mini· xAI	77.8	n/a
90	o3 Mini (batch)· OpenAI	76.9	$0.55
91	o3 Mini· OpenAI	76.9	$1.10
92	o1· OpenAI	73.3	$15.00
93	Qwen3 Max· Alibaba Qwen	73.3	$0.78
94	Gemma 4 31B· Google DeepMind	73.3	$0.20
95	Gemini 2.5 Flash· Google DeepMind	73.0	$0.30
96	Claude Sonnet 4· Anthropic	71.1	$3.00
97	Gemini 3.5 Flash Lite· Google DeepMind	71.1	$0.30
98	MiniMax M3· minimax	71.1	$0.30
99	Qwen3.5-35B-A3B· Alibaba Qwen	70.0	$0.14
100	Claude Opus 4.1· Anthropic	68.9	$15.00
101	Qwen3 32B· Alibaba Qwen	66.9	$0.08
102	Claude Haiku 4.5· Anthropic	66.6	$1.00
103	Qwen3 14B· Alibaba Qwen	66.4	$0.10
104	R1 0528· DeepSeek	66.4	$0.50
105	gpt-oss-20b· OpenAI	65.2	$0.03
106	Claude Opus 4· Anthropic	64.4	$15.00
107	Qwen3 30B A3B· Alibaba Qwen	62.7	$0.12
108	Qwen3.5-9B· Alibaba Qwen	61.6	$0.17
109	QwQ 32B· Alibaba Qwen	59.1	$0.15
110	Claude 3.7 Sonnet· Anthropic	57.7	n/a
111	Gemini 2.0 Flash Thinking (Jan 2025)· Google DeepMind	57.7	n/a
112	Qwen3 8B· Alibaba Qwen	56.1	$0.12
113	DeepSeek R1 Distill Qwen 32B· DeepSeek	55.5	n/a
114	Grok 3· xAI	55.5	n/a
115	R1· DeepSeek	53.3	$0.70
116	DeepSeek R1 Distill Qwen 14B· DeepSeek	50.5	n/a
117	o1-mini· OpenAI	46.9	n/a
118	GPT-4.1 Mini· OpenAI	44.7	$0.40
119	GPT-4.1· OpenAI	38.3	$2.00
120	GPT-4.5· OpenAI	37.7	n/a
121	Mistral Medium 3· Mistral AI	32.1	$0.40
122	Gemini 2.0 Flash (Dec 2024)· Google DeepMind	31.0	n/a
123	Gemini 2.0 Flash· Google DeepMind	31.0	$0.10
124	o1-preview· OpenAI	31.0	n/a
125	Mistral Small 3.2 24B· Mistral AI	30.2	$0.10
126	U Magistral Small 1.1· Unknown	29.9	n/a
127	GPT-4.1 Nano· OpenAI	28.8	$0.10
128	Gemma 3 27B· Google DeepMind	22.4	$0.08
129	Llama 4 Maverick· Meta	20.5	$0.35
130	Gemma 3 27B (free)· Google DeepMind	19.6	$0.00
131	Gemma 3 12B· Google DeepMind	16.6	$0.05
132	Qwen2.5-Max· Alibaba Qwen	16.0	n/a
133	DeepSeek V3· DeepSeek	15.8	$0.32
134	Phi 4· Microsoft	13.7	$0.07
135	Grok-2 (Dec 2024)· xAI	11.4	n/a
136	Llama 3.1 405B· Meta	9.6	n/a
137	Mistral Large 2407· Mistral AI	8.4	$2.00
138	Qwen2.5 72B Instruct· Alibaba Qwen	8.0	$0.36
139	Llama 4 Scout· Meta	7.7	$0.10
140	Mistral Large 2411· Mistral AI	7.7	$2.00
141	Gemma 3 4B· Google DeepMind	7.4	$0.05
142	Qwen2.5 32B Instruct· Alibaba	7.3	n/a
143	GPT-4o-mini (2024-07-18)· OpenAI	6.8	$0.15
144	GPT-4o-mini· OpenAI	6.8	$0.15
145	Gemini 1.5 Pro (Feb 2024)· Google DeepMind	6.7	n/a
146	Gemini 1.5 Pro (May 2024)· Google DeepMind	6.7	n/a
147	Mistral Small 3· Mistral AI	6.6	$0.05
148	Claude 3.5 Sonnet· Anthropic	6.4	n/a
149	GPT-4o (2024-08-06)· OpenAI	6.3	$2.50
150	GPT-4o (2024-05-13)· OpenAI	6.2	$5.00
151	GPT-4o (2024-11-20)· OpenAI	6.2	$2.50
152	Mistral Small 3.1 24B· Mistral AI	5.7	$0.35
153	Llama 3.3 70B Instruct· Meta	5.0	$0.71
154	Llama 3.3 70B Instruct (free)· Meta	5.0	$0.00
155	Claude 3 Opus· Anthropic	4.6	n/a
156	Llama 3 70B Instruct· Meta	4.2	$0.51
157	Llama 3-70B· Meta	4.2	n/a
158	Claude 3.5 Haiku· Anthropic	4.2	n/a
159	Gemini 1.5 Flash (May 2024)· Google DeepMind	3.8	n/a
160	Llama 3.1 70B Instruct· Meta	3.5	$0.72
161	Llama 3.2 90B· Meta	2.5	n/a
162	Qwen2.5 7B Instruct· Alibaba Qwen	2.4	$0.10
163	Claude 2· Anthropic	2.4	n/a
164	Claude 3 Sonnet· Anthropic	2.4	n/a
165	GPT-3.5 Turbo (older v0613)· OpenAI	2.1	$1.00
166	Mistral Large· Mistral AI	1.9	$2.00
167	Claude 2.1· Anthropic	1.9	n/a
168	Claude 3 Haiku· Anthropic	1.7	$0.25
169	Llama 3.1 8B Instruct· Meta	1.6	$0.02
170	Gemma 2 27B· Google DeepMind	1.3	$0.65
171	GPT-4 Turbo (batch)· OpenAI	1.0	$5.00
172	GPT-4 Turbo· OpenAI	1.0	$10.00
173	Gemini 1.0 Pro· Google DeepMind	1.0	n/a
174	Llama 3 8B Instruct· Meta	0.7	$0.14
175	Llama 3.2 1B Instruct· Meta	0.5	$0.03
176	GPT-4 (older v0314)· OpenAI	0.5	$30.00
177	Gemma 2 9B· Google DeepMind	0.5	$0.03