Benchmark · KnowledgeSettled

GPQA

Updated 2025-10-17
Models tested
72
Top score
19.7
Meta Llama 3 8B
Median
4.8
min 0.5
Top-5 spread
σ 0.8
Settled

Best score over time · one chart, every benchmark

GPQA32 MODELS · FRONTIER RUNNING MAX0255075100SCORE ↑Aug 24Nov 24Mar 25Jul 25Oct 25RELEASE DATE →benchgecko.ai/benchmark/hf-gpqa · frontier
Only 32 models have been tested on GPQA · not enough history to compute a frontier yet.
Pink dots = frontier records · 0 totalClick to open model page

72 models tested · sorted by score

#ModelScore
1Meta logoMeta Llama 3 8B19.7
2
HA
Qwen2.5 72B Instruct Abliterated
19.4
3Alibaba Qwen logoQwen2-72B19.2
4DeepSeek logoDeepSeek R1 Distill Qwen 14B18.3
5Microsoft logoWizardLM-2 8x22B17.6
6Google DeepMind logoGemma 2 27B16.7
7Alibaba Qwen logoQwen2.5 72B Instruct16.7
8
U
Yi 6B
15.6
9nousresearch logoHermes 3 70B Instruct14.9
10Google DeepMind logoGemma 2 9B14.8
11Meta logoLlama 3.1 70B Instruct14.2
12Alibaba Qwen logoQwen2.5 Coder 32B Instruct13.2
13
D
Dolphin 2.9.1 Yi 1.5 34b
12.4
14Microsoft logoPhi 3.5 Mini Instruct12.0
15Alibaba logoQwen2.5 32B Instruct11.7
16Microsoft logoPhi 411.5
17Microsoft logoPhi 3 Mini 4k Instruct11.0
18Meta logoLlama 3.3 70B Instruct10.5
19Alibaba logoQwen2.5 14B Instruct10.5
20anthracite-org logoMagnum v4 72B10.4
21Meta logoLlama 3.1 8B Instruct9.5
22Alibaba logoQwen2 VL 7B Instruct9.3
23z-ai logoGLM 4 32B 8.8
24
U
Stable Beluga 2
8.8
25Meta logoLlama 3-70B8.1
26Microsoft logoPhi 4 Mini Instruct7.9
27Microsoft logoPhi 4 Mini Instruct7.9
28Alibaba logoQwen2.5 Coder 14B Instruct7.3
29Alibaba logoQwen2 7B Instruct6.4
30Meta logoLlama 3.1 405B5.9
31nousresearch logoHermes 2 Pro - Llama-3 8B5.7
32Mistral AI logoMistral 7B V0.15.6
33Alibaba logoQwen2.5 Coder 7B Instruct5.6
34Alibaba Qwen logoQwen2.5 Coder 7B Instruct5.6
35Alibaba Qwen logoQwen2.5 7B Instruct5.5
36Google DeepMind logoGemma 2B4.9
37DeepSeek logoDeepSeek R1 Distill Qwen 32B4.6
38DeepSeek logoR1 Distill Qwen 32B4.6
39DeepSeek logoDeepSeek R1 Distill Qwen 7B3.9
40Meta logoLlama 3.2 3B Instruct3.8
41Meta logoLLaMA-13B3.5
42Mistral AI logoMistral 7B Instruct V0.23.5
43Google DeepMind logoGemma 2 2b It3.2
44
U
StarCoder 2 15B
3.1
45Alibaba logoQwen2.5 3B Instruct3.0
46Microsoft logoPhi 22.9
47TII logoFalcon-180B2.8
48Meta logoLlama 3.2 1B Instruct2.4
49Meta logoLlama 3.2 3B Instruct (free)2.4
50Microsoft logoPhi-1.52.4
51Meta logoLlama 2 7b Hf2.2
52Meta logoLlama 3 8B Instruct2.1
53DeepSeek logoR1 Distill Llama 70B2.0
54Google DeepMind logoGemma 2 2b1.7
55OpenAI logoGpt2 Medium1.7
56Alibaba logoQwen2 1.5B Instruct1.6
57Alibaba logoQwen2 0.5B1.4
58
U
MPT-30B
1.3
59Alibaba Qwen logoQwQ 32B1.3
60
D
Distilgpt2
1.2
61OpenAI logoGpt2 Large1.2
62Meta logoMeta Llama 3 8B Instruct1.2
63Alibaba logoQwen2.5 0.5B Instruct1.2
64OpenAI logoGpt21.1
65eleutherai logoPythia 160m1.1
66
L
Vicuna 7b V1.5
1.1
67DeepSeek logoDeepSeek R1 Distill Qwen 1.5B0.8
68Alibaba logoQwen2.5 1.5B Instruct0.8
69DeepSeek logoDeepSeek R1 Distill Llama 8B0.7
70
U
RedPajama-INCITE-7B-Base
0.7
71eleutherai logoGpt Neo 125m0.5
72Meta logoLlama 2 7b Chat Hf0.5

Same category · related evaluations