Beta
Benchmark · Knowledge

CSQA2

Updated 2024-01-25
Models tested
2
Top score
14.0
GPT-3.5 Turbo (older v0613)
Median
7.0
min 0.1
Top-5 spread
σ 7.0
wide open

Where models cluster

SCORE DISTRIBUTION10–10110–2020–3030–4040–5050–6060–7070–8080–9090–100MEDIAN · 7.0SCORE BUCKET → (0 TO 100)MODELSbenchgecko.ai

Pearson r · original research

Not enough overlapping models yet.

2 models tested · sorted by score

#ModelScore
1OpenAI logoGPT-3.5 Turbo (older v0613)14.0
2Meta logoLlama 2-13B0.1

Pulled from the CSQA2 dataset · updated daily

What does CSQA2 measure?

CSQA2 is a knowledge benchmark in the BenchGecko catalog. 2 AI models have been tested on it. Scores range from 0.1 to 14.0 out of 100.

Which model leads on CSQA2?

GPT-3.5 Turbo (older v0613) from OpenAI leads CSQA2 with a score of 14.0. The median score across 2 tested models is 7.0.

Is CSQA2 saturated?

No · the top score is 14.0 out of 100 (14%). There is still meaningful room for improvement on CSQA2.

What makes CSQA2 distinctive?

CSQA2 is a knowledge benchmark with limited overlap to the rest of the catalog · it measures capabilities that are not well-covered by other benchmarks we track.

How often is CSQA2 data refreshed?

BenchGecko pulls updates daily. New model scores on CSQA2 appear as soon as they are published by Epoch AI or the model provider.

Same category · related evaluations