TriviaQA
TriviaQA · reading comprehension benchmark with trivia questions, requiring models to find and reason over evidence from provided documents.
The Frontier
Best score over time · one chart, every benchmark
Full rankings
24 models tested · sorted by score
| # | Model | Score |
|---|---|---|
| 1 | 87.5 | |
| 2 | U PaLM 2-L | 86.1 |
| 3 | 85.8 | |
| 4 | 84.8 | |
| 5 | 82.9 | |
| 6 | 82.7 | |
| 7 | 82.2 | |
| 8 | 82.2 | |
| 9 | U PaLM 2-M | 81.7 |
| 10 | 80.0 | |
| 11 | 79.9 | |
| 12 | 79.6 | |
| 13 | 78.9 | |
| 14 | 77.9 | |
| 15 | 75.2 | |
| 16 | U PaLM 2-S | 75.2 |
| 17 | 73.9 | |
| 18 | U MPT-30B | 73.6 |
| 19 | 71.9 | |
| 20 | 67.7 | |
| 21 | 64.0 | |
| 22 | 58.1 | |
| 23 | 53.2 | |
| 24 | 45.2 |
Score distribution
Where models cluster
Correlated benchmarks
Pearson r · original research
Benchmarks that track with TriviaQA
Pearson correlation across models scored on both benchmarks. Closer to 1 = strongly predictive.
Frequently asked
About TriviaQA
What does TriviaQA measure?
TriviaQA · reading comprehension benchmark with trivia questions, requiring models to find and reason over evidence from provided documents. 24 AI models have been tested on it. Scores range from 45.2 to 87.5 out of 100.
Which model leads on TriviaQA?
Claude 2 from Anthropic leads TriviaQA with a score of 87.5. The median score across 24 tested models is 79.3.
Is TriviaQA saturated?
No · the top score is 87.5 out of 100 (88%). There is still meaningful room for improvement on TriviaQA.
Does TriviaQA predict performance on other benchmarks?
Yes · TriviaQA scores correlate 0.89 with HellaSwag across 20 shared models. Models that do well on TriviaQA tend to do well on HellaSwag.
How often is TriviaQA data refreshed?
BenchGecko pulls updates daily. New model scores on TriviaQA appear as soon as they are published by Epoch AI or the model provider.
- Category
- Knowledge
- Max score
- 100
- Models
- 24
- Updated
- 2024-12-26
Top on TriviaQA
Claude 2 · 87.5PaLM 2-L · 86.1GPT-3.5 Turbo (older v0613) · 85.8GPT-4 Turbo · 84.8DeepSeek V3 · 82.9More knowledge benchmarks
Same category · related evaluations