Which model leads on SimpleQA Verified?

Claude Fable 5.2 from Anthropic leads SimpleQA Verified with a score of 94.0. The median score across 96 tested models is 42.1.

Is SimpleQA Verified saturated?

No · the top score is 94.0 out of 100 (94%). There is still meaningful room for improvement on SimpleQA Verified.

Does SimpleQA Verified predict performance on other benchmarks?

Yes · SimpleQA Verified scores correlate 0.88 with Balrog across 17 shared models. Models that do well on SimpleQA Verified tend to do well on Balrog.

How often is SimpleQA Verified data refreshed?

BenchGecko pulls updates daily. New model scores on SimpleQA Verified appear as soon as they are published by Epoch AI or the model provider.

Benchmark · KnowledgeCompetitive

SimpleQA Verified

Name: SimpleQA Verified Benchmark
Creator: BenchGecko
License: https://creativecommons.org/licenses/by/4.0/

SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.

Updated 2026-11-09

Models tested

Top score

94.0

Claude Fable 5.2

Median

42.1

min 5.9

Top-5 spread

σ 7.8

wide open

The Frontier

Best score over time · one chart, every benchmark

Chart type

Frontier on SimpleQA Verified rose from 26.0 to 94.0 in 24 months · +68.0 points · latest leader Claude Fable 5.2 from Anthropic.

Pink dots = frontier records · 9 totalClick to open model page

Full rankings

96 models tested · sorted by score

#	Model	Score	Price
1	Claude Fable 5.2· Anthropic	94.0	$8.00
2	Gemini 4 Argon· Google DeepMind	76.0	$2.00
3	GPT-6 Astra· OpenAI	75.6	$10.00
4	GPT-6.1 Sol· OpenAI	73.9	$2.00
5	Gemini 3.1 Pro Preview· Google DeepMind	73.5	$2.00
6	Gemini 3 Pro· Google DeepMind	72.9	n/a
7	Claude Opus 5.5· Anthropic	72.2	$4.00
8	Claude Fable 5.1· Anthropic	70.8	$10.00
9	Claude Fable 5· Anthropic	70.7	$10.00
10	GPT-5.6 Sol· OpenAI	69.7	$4.00
11	Gemini 3.8 Flash· Google DeepMind	69.7	$0.82
12	Gemini 3.7 Flash· Google DeepMind	69.2	$0.75
13	Qwen3 Max· Alibaba Qwen	67.5	$0.78
14	Gemini 3 Flash Preview· Google DeepMind	67.4	$0.50
15	Muse Spark· Meta	66.3	n/a
16	Gemini 3.5 Flash· Google DeepMind	66.2	$1.50
17	Gemini 3.6 Flash· Google DeepMind	66.2	$0.75
18	GPT-5.5 Pro· OpenAI	64.5	$30.00
19	GPT-5.5· OpenAI	63.0	$5.00
20	Kimi K3.1 Pro· moonshotai	62.2	$2.00
21	GPT-6 Sol· OpenAI	60.7	$2.00
22	Claude Opus 5· Anthropic	59.9	$5.00
23	GPT-6.1 Terra· OpenAI	57.3	$1.00
24	Muse Spark Open· Meta	56.6	$1.25
25	Gemini 2.5 Pro· Google DeepMind	56.0	$1.25
26	Grok 4.7· xAI	56.0	$2.00
27	Qwen3.7 Max· Alibaba Qwen	55.8	$1.48
28	Claude Opus 4.8· Anthropic	53.0	$5.00
29	o3· OpenAI	53.0	$2.00
30	DeepSeek V4 Pro 0813· DeepSeek	52.9	$0.11
31	Qwen3.6 Max Preview· Alibaba Qwen	52.0	$1.03
32	Claude Opus 4.7· Anthropic	51.7	$5.00
33	Kimi K3· moonshotai	50.6	$0.19
34	GPT-5· OpenAI	50.6	$1.25
35	Grok 4.6· xAI	49.3	$2.00
36	Grok 4.5· xAI	48.3	$2.00
37	GPT-5.1· OpenAI	48.0	$1.25
38	Grok 4· xAI	47.9	n/a
39	GPT-5.4 Pro· OpenAI	47.8	$30.00
40	DeepSeek V4 Pro· DeepSeek	47.0	$0.88
41	Claude Sonnet 5.5· Anthropic	46.5	$2.00
42	Claude Opus 4.6· Anthropic	46.5	$5.00
43	Qwen3.8 Max (0902)· Alibaba Qwen	45.8	$2.00
44	GPT-5.4· OpenAI	45.1	$2.50
45	Qwen3.6 Plus· Alibaba Qwen	44.1	$0.33
46	GPT-5.6 Terra· OpenAI	43.2	$2.00
47	DeepSeek V4.1 Flash· DeepSeek	42.9	$0.05
48	DeepSeek V4.1 Flash 1017· DeepSeek	42.5	$0.01
49	Claude Opus 4.5· Anthropic	41.8	$5.00
50	GPT-6 Luna· OpenAI	41.4	$0.10
51	o1· OpenAI	41.1	$15.00
52	GLM 5.3· z-ai	41.0	$0.07
53	GPT-5.6 Luna· OpenAI	41.0	$0.20
54	Qwen3 235B A22B Thinking 2507· Alibaba Qwen	40.4	$0.45
55	GPT-5.2· OpenAI	38.9	$1.75
56	Kimi K2.7 Code· moonshotai	36.5	$0.60
57	Claude Sonnet 4.6· Anthropic	35.5	$3.00
58	Kimi K2.6· moonshotai	34.9	$0.65
59	Claude Opus 4.1· Anthropic	34.8	$15.00
60	Kimi K2.5· moonshotai	34.3	$0.53
61	GLM 5.2· z-ai	34.2	$0.01
62	GLM 5.1· z-ai	34.0	$1.33
63	Claude Sonnet 5· Anthropic	33.7	$2.00
64	DeepSeek V4 Flash 0731· DeepSeek	33.6	$0.04
65	Grok 4.3· xAI	33.2	$1.25
66	GLM 4.7· z-ai	32.2	$0.60
67	Kimi K2 Thinking· moonshotai	31.6	$0.60
68	GPT-4.1· OpenAI	31.1	$2.00
69	Claude Sonnet 4.5· Anthropic	30.7	$3.00
70	Grok 4.20· xAI	30.2	$1.25
71	GPT-5.4 Mini· OpenAI	29.4	$0.75
72	DeepSeek V3.2· DeepSeek	27.5	$0.26
73	R1· DeepSeek	27.4	$0.70
74	R1 0528· DeepSeek	27.4	$0.50
75	GPT-4o (2024-11-20)· OpenAI	26.0	$2.50
76	Qwen 3.5 Plus (hosted 397B-A17B)· Alibaba Qwen	25.4	n/a
77	o4 Mini· OpenAI	23.9	$1.10
78	Claude Haiku 5.5· Anthropic	23.8	$0.10
79	Mistral Large 4· Mistral AI	22.4	$0.70
80	Grok-3 mini· xAI	21.1	n/a
81	GPT-5 Mini· OpenAI	21.0	$0.25
82	Qwen3.5-Flash· Alibaba Qwen	20.3	$0.07
83	o4 Mini (batch)· OpenAI	19.6	$0.55
84	Qwen3.6 Flash· Alibaba Qwen	15.9	$0.19
85	o3 Mini (batch)· OpenAI	15.3	$0.55
86	o3 Mini· OpenAI	15.3	$1.10
87	gpt-oss-120b· OpenAI	13.9	$0.15
88	GPT-4.1 Mini· OpenAI	12.7	$0.40
89	Claude 3 Opus· Anthropic	12.6	n/a
90	GPT-5.4 Nano· OpenAI	11.7	$0.20
91	GPT-5 Nano· OpenAI	11.7	$0.05
92	Gemma 4 31B· Google DeepMind	10.4	$0.20
93	GPT-4o-mini· OpenAI	8.3	$0.15
94	Claude 3.5 Haiku· Anthropic	6.7	n/a
95	GPT-4.1 Nano· OpenAI	6.0	$0.10
96	Claude Haiku 4.5· Anthropic	5.9	$1.00