Beta
Benchmark · Knowledge

PropensityBench

Updated 2024-09-17
Models tested
1
Top score
22.9
Qwen2.5 32B Instruct
Median
22.9
min 22.9
Top-5 spread
σ 0.0
settled

Where models cluster

SCORE DISTRIBUTION0–1010–20120–3030–4040–5050–6060–7070–8080–9090–100MEDIAN · 22.9SCORE BUCKET → (0 TO 100)MODELSbenchgecko.ai

Pearson r · original research

Not enough overlapping models yet.

1 models tested · sorted by score

#ModelScore
1Alibaba logoQwen2.5 32B Instruct22.9

Pulled from the PropensityBench dataset · updated daily

What does PropensityBench measure?

PropensityBench is a knowledge benchmark in the BenchGecko catalog. 1 AI models have been tested on it. Scores range from 22.9 to 22.9 out of 100.

Which model leads on PropensityBench?

Qwen2.5 32B Instruct from Alibaba leads PropensityBench with a score of 22.9. The median score across 1 tested models is 22.9.

Is PropensityBench saturated?

No · the top score is 22.9 out of 100 (23%). There is still meaningful room for improvement on PropensityBench.

What makes PropensityBench distinctive?

PropensityBench is a knowledge benchmark with limited overlap to the rest of the catalog · it measures capabilities that are not well-covered by other benchmarks we track.

How often is PropensityBench data refreshed?

BenchGecko pulls updates daily. New model scores on PropensityBench appear as soon as they are published by Epoch AI or the model provider.

Same category · related evaluations