Skills/Math & Reasoning

Math & Reasoning

Mathematical problem solving, logical reasoning, and multi-step inference — from arithmetic to competition-level mathematics.

165

Models Ranked

91.1

Top Score

35.0

Average Score

Benchmarks

Benchmarks in This Skill

BBH GSM8K MATH level 5 OTIS Mock AIME 2024-2025 SimpleBench FrontierMath-2025-02-28-Private FrontierMath-Tier-4-2025-07-01-Private ARC-AGI-2 ARC-AGI

Rankings

#	Model	Avg Score	Tests
1	Qwen2.5 Coder 32B InstructAlibaba Qwen	91.1	1/9
2	Qwen2.5 Coder 7B InstructAlibaba Qwen	86.7	1/9
3	Claude InstantAnthropic	86.7	1/9
4	Qwen3 MaxAlibaba Qwen	85.2	2/9
5	Gemini 2.0 ProGoogle	83.5	1/9
6	phi-3-small 7.4BMicrosoft	72.1	1/9
7	DeepSeek-V2 (MoE-236B, May 2024)DeepSeek	71.7	1/9
8	Gemini 3.1 Pro PreviewGoogle DeepMind	66.6	6/9
9	Qwen2.5-Coder (1.5B)Alibaba	65.8	1/9
10	U Stable Beluga 2unknown	64.3	2/9
11	Claude Opus 4.6Anthropic	63.7	6/9
12	phi-3-mini 3.8BMicrosoft	62.3	1/9
13	GPT-5.4OpenAI	61.0	4/9
14	GPT-5.4 ProOpenAI	59.9	4/9
15	U StarCoder 2 15Bunknown	57.7	1/9
16	GPT-5.2 ChatOpenAI	54.9	6/9
17	GPT-5.2OpenAI	54.9	6/9
18	T Falcon-180BTII	54.4	1/9
19	Gemini 3 ProGoogle	54.3	6/9
20	T Falcon 2 11BTII	53.8	1/9
21	Gemini 2.5 FlashGoogle DeepMind	52.7	2/9
22	GPT-5 ChatOpenAI	51.1	7/9
23	GPT-5OpenAI	51.1	7/9
24	Qwen-14BAlibaba	50.6	2/9
25	LLaMA-65BMeta	49.5	2/9
26	Qwen2.5 72B InstructAlibaba Qwen	48.1	3/9
27	Mistral 7B v0.1Mistral	47.9	2/9
28	U Yi-34Bunknown	47.8	3/9
29	gpt-oss-120b (free)OpenAI	47.7	2/9
30	gpt-oss-120bOpenAI	47.7	2/9
31	gpt-oss-20b (free)OpenAI	47.7	2/9
32	gpt-oss-20bOpenAI	47.7	2/9
33	Mistral NemoMistral AI	47.5	2/9
34	o1OpenAI	47.2	5/9
35	Claude Opus 4.5Anthropic	47.2	6/9
36	Gemma 3 4B (free)Google DeepMind	46.8	2/9
37	Gemma 3 4BGoogle DeepMind	46.8	2/9
38	Gemma 3 12B (free)Google DeepMind	46.8	2/9
39	Gemma 3 12BGoogle DeepMind	46.8	2/9
40	Gemma 3 27B (free)Google DeepMind	46.8	2/9
41	Gemma 3 27BGoogle DeepMind	46.8	2/9
42	Claude Sonnet 4.6Anthropic	46.7	4/9
43	phi-3-medium 14BMicrosoft	46.4	2/9
44	Phi-2Microsoft	45.9	1/9
45	U Nemotron-4 15Bunknown	45.5	2/9
46	GPT-4 TurboOpenAI	45.2	4/9
47	GPT-4 Turbo (older v1106)OpenAI	45.2	4/9
48	GPT-4 (older v0314)OpenAI	45.2	4/9
49	GPT-4OpenAI	45.2	4/9
50	o3OpenAI	44.8	7/9

Other Skills