SimpleQA Verified
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information.
The Frontier
Best score over time · one chart, every benchmark
Full rankings
47 models tested · sorted by score
| # | Model | Score |
|---|---|---|
| 1 | 77.3 | |
| 2 | 72.9 | |
| 3 | 68.4 | |
| 4 | 68.3 | |
| 5 | 67.5 | |
| 6 | 67.4 | |
| 7 | U Muse Spark | 66.3 |
| 8 | 58.5 | |
| 9 | 56.9 | |
| 10 | 56.0 | |
| 11 | 53.0 | |
| 12 | 50.6 | |
| 13 | 50.6 | |
| 14 | 50.1 | |
| 15 | 49.1 | |
| 16 | 48.9 | |
| 17 | 47.9 | |
| 18 | 47.8 | |
| 19 | 46.5 | |
| 20 | 44.8 | |
| 21 | 41.8 | |
| 22 | 39.5 | |
| 23 | 39.2 | |
| 24 | 38.9 | |
| 25 | 38.7 | |
| 26 | 37.3 | |
| 27 | 34.8 | |
| 28 | 33.9 | |
| 29 | 31.6 | |
| 30 | 31.5 | |
| 31 | 29.0 | |
| 32 | 28.6 | |
| 33 | 27.5 | |
| 34 | 27.4 | |
| 35 | 27.4 | |
| 36 | 26.0 | |
| 37 | 23.9 | |
| 38 | 23.6 | |
| 39 | 21.2 | |
| 40 | 21.1 | |
| 41 | 21.0 | |
| 42 | 19.8 | |
| 43 | 13.9 | |
| 44 | 12.2 | |
| 45 | 12.0 | |
| 46 | 6.7 | |
| 47 | 5.9 |
Score distribution
Where models cluster
Correlated benchmarks
Pearson r · original research
Benchmarks that track with SimpleQA Verified
Pearson correlation across models scored on both benchmarks. Closer to 1 = strongly predictive.
Frequently asked
About SimpleQA Verified
What does SimpleQA Verified measure?
SimpleQA Verified · short factual questions with verified answers, measuring factual accuracy and the tendency to hallucinate or provide incorrect information. 47 AI models have been tested on it. Scores range from 5.9 to 77.3 out of 100.
Which model leads on SimpleQA Verified?
Gemini 3.1 Pro Preview from Google DeepMind leads SimpleQA Verified with a score of 77.3. The median score across 47 tested models is 38.9.
Is SimpleQA Verified saturated?
No · the top score is 77.3 out of 100 (77%). There is still meaningful room for improvement on SimpleQA Verified.
Does SimpleQA Verified predict performance on other benchmarks?
Yes · SimpleQA Verified scores correlate 0.90 with Balrog across 10 shared models. Models that do well on SimpleQA Verified tend to do well on Balrog.
How often is SimpleQA Verified data refreshed?
BenchGecko pulls updates daily. New model scores on SimpleQA Verified appear as soon as they are published by Epoch AI or the model provider.
- Category
- Knowledge
- Max score
- 100
- Models
- 47
- Updated
- 2026-06-12
Top on SimpleQA Verified
Gemini 3.1 Pro Preview · 77.3Gemini 3 Pro · 72.9Gemini 3.5 Flash · 68.4Claude Fable 5 · 68.3Qwen3 Max · 67.5More knowledge benchmarks
Same category · related evaluations