HLE
HLE (Humanity's Last Exam) · a reasoning benchmark designed to be the hardest public evaluation of AI. Questions span mathematics, physics, philosophy, and logic · curated to be at or beyond the frontier of human expert capability. Tested with and without tool augmentation.
Humanity's Last Exam lives up to its name.
Scoring: Accuracy on verified questions. Evaluated in two modes: no-tools (pure reasoning) and with-tools (code execution + search access). Scores reported separately per mode.
The Frontier
Best score over time · one chart, every benchmark
Full rankings
36 models tested · sorted by score · includes 5 verified scores
| # | Model | Score |
|---|---|---|
| 1 | 56.8 | |
| 2 | 52.5 | |
| 3 | 44.4 | |
| 4 | 43.8 | |
| 5 | 43.7 | |
| 6 | 43.4 | |
| 7 | 41.7 | |
| 8 | 41.5 | |
| 9 | 37.6 | |
| 10 | 34.4 | |
| 11 | 33.0 | |
| 12 | 33.0 | |
| 13 | 31.1 | |
| 14 | 28.2 | |
| 15 | 26.6 | |
| 16 | 24.2 | |
| 17 | 21.6 | |
| 18 | 21.4 | |
| 19 | 20.6 | |
| 20 | 19.8 | |
| 21 | 17.7 | |
| 22 | 16.3 | |
| 23 | 15.4 | |
| 24 | 13.9 | |
| 25 | 9.4 | |
| 26 | 7.7 | |
| 27 | 7.1 | |
| 28 | 6.2 | |
| 29 | 4.0 | |
| 30 | 3.4 | |
| 31 | 3.3 | |
| 32 | 3.1 | |
| 33 | 1.9 | |
| 34 | 0.9 | |
| 35 | 0.7 | |
| 36 | 0.6 |
Score distribution
Where models cluster
Correlated benchmarks
Pearson r · original research
Benchmarks that track with HLE
Pearson correlation across models scored on both benchmarks. Closer to 1 = strongly predictive.
How it works
Evaluation methodology
Humanity's Last Exam is a crowd-sourced collection of the hardest questions humans can write, spanning mathematics, physics, philosophy, logic, and esoteric knowledge domains. Questions are sourced from domain experts and designed to be at or beyond PhD-level difficulty. The evaluation is conducted in two settings: without tools (pure reasoning) and with tools (code execution, search). Each question has a verified correct answer. The benchmark is maintained as a living dataset with new questions added to prevent contamination.
Industry relevance
Why teams track this benchmark
HLE is the ceiling benchmark. This benchmark will be the last to saturate, and tracking its frontier progression is the purest signal of AGI-relevant progress.
Practical takeaways
By role
Do not build products that require HLE-level reasoning from AI today. Use this benchmark to track when hard-reasoning products become viable.
Track this delta across model generations.
Frequently asked
About HLE
What does HLE measure?
HLE (Humanity's Last Exam) · a reasoning benchmark designed to be the hardest public evaluation of AI. Questions span mathematics, physics, philosophy, and logic · curated to be at or beyond the frontier of human expert capability. Tested with and without tool augmentation. 34 AI models have been tested on it. Scores range from 0.6 to 52.5 out of 100.
Which model leads on HLE?
GPT-6 Astra from OpenAI leads HLE with a score of 52.5. The median score across 34 tested models is 20.2.
Is HLE saturated?
No · the top score is 52.5 out of 100 (53%). There is still meaningful room for improvement on HLE.
Does HLE predict performance on other benchmarks?
Yes · HLE scores correlate 0.99 with Artificial Analysis · MMMU Pro across 5 shared models. Models that do well on HLE tend to do well on Artificial Analysis · MMMU Pro.
How often is HLE data refreshed?
BenchGecko pulls updates daily. New model scores on HLE appear as soon as they are published by Epoch AI or the model provider.
- Category
- Reasoning
- Creator
- Scale AI / CAIS
- Max score
- 100
- Modality
- Text
- Scoring
- Accuracy on verified questions. Evaluated in two modes: no-tools (pure reasoning) and with-tools (code execution + search access). Scores reported separately per mode.
- Models
- 36
- Updated
- 2026-10-07
“HLE is the benchmark that will matter the longest. Everything else saturates; HLE endures.”
Top on HLE
Claude Mythos Preview · 56.8GPT-6 Astra · 52.5Gemini 3.1 Pro · 44.4Claude Fable 5.1 · 43.8Gemini 3.1 Pro Preview · 43.7More reasoning benchmarks
Same category · related evaluations