MMMLU · German
Distribution
Where models cluster
Correlated benchmarks
Pearson r · original research
Full rankings
2 models tested · sorted by score
| # | Model | Score |
|---|---|---|
| 1 |  Qwen2 7B Instruct | 57.1 |
| 2 |  Meta Llama 3 8B Instruct | 53.5 |
Frequently asked
Pulled from the MMMLU · German dataset · updated daily
What does MMMLU · German measure?
MMMLU · German is a knowledge benchmark in the BenchGecko catalog. 2 AI models have been tested on it. Scores range from 53.5 to 57.1 out of 100.
Which model leads on MMMLU · German?
Qwen2 7B Instruct from Alibaba leads MMMLU · German with a score of 57.1. The median score across 2 tested models is 55.3.
Is MMMLU · German saturated?
No · the top score is 57.1 out of 100 (57%). There is still meaningful room for improvement on MMMLU · German.
What makes MMMLU · German distinctive?
MMMLU · German is a knowledge benchmark with limited overlap to the rest of the catalog · it measures capabilities that are not well-covered by other benchmarks we track.
How often is MMMLU · German data refreshed?
BenchGecko pulls updates daily. New model scores on MMMLU · German appear as soon as they are published by Epoch AI or the model provider.
More knowledge benchmarks
Same category · related evaluations