JNLI
The Frontier
Best score over time · one chart, every benchmark
Full rankings
12 models tested · sorted by score
| # | Model | Score |
|---|---|---|
| 1 | 85.6 | |
| 2 | 82.4 | |
| 3 | 81.3 | |
| 4 | 74.4 | |
| 5 | 69.4 | |
| 6 | 61.1 | |
| 7 | 60.9 | |
| 8 | 57.1 | |
| 9 | HF SmolLM2 135M Instruct | 55.3 |
| 10 | 54.6 | |
| 11 | 36.1 | |
| 12 | 35.6 |
Score distribution
Where models cluster
Correlated benchmarks
Pearson r · original research
Benchmarks that track with JNLI
Pearson correlation across models scored on both benchmarks. Closer to 1 = strongly predictive.
Frequently asked
About JNLI
What does JNLI measure?
JNLI is a knowledge benchmark in the BenchGecko catalog. 12 AI models have been tested on it. Scores range from 35.6 to 85.6 out of 100.
Which model leads on JNLI?
DeepSeek R1 Distill Qwen 32B from DeepSeek leads JNLI with a score of 85.6. The median score across 12 tested models is 61.0.
Is JNLI saturated?
No · the top score is 85.6 out of 100 (86%). There is still meaningful room for improvement on JNLI.
Does JNLI predict performance on other benchmarks?
Yes · JNLI scores correlate 0.85 with JMMLU across 12 shared models. Models that do well on JNLI tend to do well on JMMLU.
How often is JNLI data refreshed?
BenchGecko pulls updates daily. New model scores on JNLI appear as soon as they are published by Epoch AI or the model provider.
- Category
- Knowledge
- Max score
- 100
- Models
- 12
- Updated
- 2025-01-20
Top on JNLI
DeepSeek R1 Distill Qwen 32B · 85.6DeepSeek R1 Distill Qwen 14B · 82.4Qwen2 7B Instruct · 81.3Qwen2 VL 7B Instruct · 74.4DeepSeek R1 Distill Llama 8B · 69.4More knowledge benchmarks
Same category · related evaluations