Benchmark · KnowledgeCompetitive

MUSR

Updated 2025-10-17
Models tested
78
Top score
28.7
DeepSeek R1 Distill Qwen 14B
Median
9.5
min 0.5
Top-5 spread
σ 3.7
Competitive

Best score over time · one chart, every benchmark

MUSR34 MODELS · FRONTIER RUNNING MAX0255075100SCORE ↑Aug 24Nov 24Mar 25Jul 25Oct 25RELEASE DATE →benchgecko.ai/benchmark/hf-musr · frontier
Frontier on MUSR rose from 23.4 to 28.7 in 5 months · +5.3 points · latest leader DeepSeek R1 Distill Qwen 14B from DeepSeek.
Pink dots = frontier records · 2 totalClick to open model page

78 models tested · sorted by score

#ModelScore
1DeepSeek logoDeepSeek R1 Distill Qwen 14B28.7
2nousresearch logoHermes 3 70B Instruct23.4
3Meta logoLlama 3 8B Instruct19.9
4Alibaba Qwen logoQwen2-72B19.7
5
U
Stable Beluga 2
18.6
6Meta logoLlama 3.1 70B Instruct17.7
7
D
Dolphin 2.9.1 Yi 1.5 34b
17.0
8DeepSeek logoDeepSeek R1 Distill Qwen 32B16.1
9DeepSeek logoR1 Distill Qwen 32B16.1
10Meta logoMeta Llama 3 8B16.0
11Meta logoLlama 3.3 70B Instruct15.6
12OpenAI logoGpt215.3
13Microsoft logoWizardLM-2 8x22B14.5
14z-ai logoGLM 4 32B 14.2
15Microsoft logoPhi 213.8
16Alibaba Qwen logoQwen2.5 Coder 32B Instruct13.7
17Alibaba logoQwen2 VL 7B Instruct13.6
18Alibaba logoQwen2.5 32B Instruct13.5
19anthracite-org logoMagnum v4 72B13.4
20DeepSeek logoR1 Distill Llama 70B13.3
21Microsoft logoPhi 3 Mini 4k Instruct13.1
22
HA
Qwen2.5 72B Instruct Abliterated
12.3
23Alibaba logoQwen2 1.5B Instruct12.0
24Alibaba Qwen logoQwen2.5 72B Instruct11.7
25
L
Vicuna 7b V1.5
11.4
26Google DeepMind logoGemma 2 2b11.3
27nousresearch logoHermes 2 Pro - Llama-3 8B11.3
28
D
Distilgpt2
11.2
29Alibaba Qwen logoQwQ 32B11.1
30Google DeepMind logoGemma 2B11.0
31Mistral AI logoMistral 7B V0.110.7
32eleutherai logoPythia 160m10.7
33Alibaba logoQwen2.5 14B Instruct10.6
34Microsoft logoPhi 410.1
35Microsoft logoPhi 3.5 Mini Instruct10.1
36
HF
SmolLM2 135M
10.0
37Google DeepMind logoGemma 2 9B9.7
38
U
Yi 6B
9.7
39Alibaba logoQwen2.5 Coder 7B Instruct9.5
40Alibaba Qwen logoQwen2.5 Coder 7B Instruct9.5
41Google DeepMind logoGemma 2 27B9.1
42Meta logoLlama 3.1 8B Instruct8.5
43Alibaba Qwen logoQwen2.5 7B Instruct8.4
44Mistral AI logoMistral 7B Instruct V0.27.6
45Alibaba logoQwen2.5 3B Instruct7.6
46TII logoFalcon-180B7.5
47Alibaba logoQwen2 7B Instruct7.4
48Meta logoLlama 3-70B7.1
49Google DeepMind logoGemma 2 2b It7.1
50Alibaba logoQwen2.5 Coder 14B Instruct7.0
51Microsoft logoPhi 4 Mini Instruct6.5
52Microsoft logoPhi 4 Mini Instruct6.5
53OpenAI logoGpt2 Medium6.2
54Mistral AI logoMistral 7B Instruct v0.16.1
55OpenAI logoGpt2 Large5.7
56Alibaba logoQwen2 0.5B4.6
57
T
TinyLlama 1.1B Chat V1.0
4.3
58
U
INTELLECT-1
4.1
59Meta logoLlama 3.2 3B Instruct (free)3.8
60Meta logoLlama 2 7b Hf3.8
61
HF
SmolLM2 135M Instruct
3.7
62DeepSeek logoDeepSeek R1 Distill Qwen 7B3.5
63Microsoft logoPhi-1.53.4
64Meta logoLlama 2 7b Chat Hf3.3
65Alibaba logoQwen2.5 1.5B Instruct3.2
66
U
RedPajama-INCITE-7B-Base
3.0
67DeepSeek logoDeepSeek R1 Distill Qwen 1.5B3.0
68
U
StarCoder 2 15B
2.9
69
U
MPT-30B
2.9
70eleutherai logoGpt Neo 125m2.6
71Alibaba logoQwen2 0.5B Instruct2.4
72Meta logoLlama 3.1 405B2.2
73Meta logoLLaMA-13B2.0
74Meta logoLlama 3.2 1B Instruct1.9
75Meta logoMeta Llama 3 8B Instruct1.6
76Meta logoLlama 3.2 3B Instruct1.4
77Alibaba logoQwen2.5 0.5B Instruct1.4
78DeepSeek logoDeepSeek R1 Distill Llama 8B0.5

Same category · related evaluations