Skills/Coding

Coding

Code generation, debugging, and software engineering tasks — from writing functions to fixing real-world GitHub issues.

109

Models Ranked

75.3

Top Score

32.9

Average Score

Benchmarks

Benchmarks in This Skill

WeirdML Aider polyglot GSO-Bench SWE-Bench Verified (Bash Only)Terminal Bench CadEval Cybench

Rankings

#	Model	Avg Score	Tests
1	Gemini 3.1 Pro PreviewGoogle DeepMind	75.3	2/7
2	DeepSeek V3.2DeepSeek	74.2	1/7
3	o3 ProOpenAI	71.6	2/7
4	Claude Sonnet 4.6Anthropic	66.1	1/7
5	GPT-5 ProOpenAI	60.4	1/7
6	Claude Opus 4.6Anthropic	60.4	3/7
7	GPT-5.2 ChatOpenAI	59.1	4/7
8	GPT-5.2OpenAI	59.1	4/7
9	GPT-5.4OpenAI	57.4	1/7
10	Claude Opus 4.5Anthropic	56.9	4/7
11	DeepSeek V3.2 ExpDeepSeek	56.8	2/7
12	DeepSeek-R1 (May 2025)DeepSeek	56.5	2/7
13	Gemini 3 ProGoogle	56.1	4/7
14	o3OpenAI	55.0	5/7
15	GPT-5 ChatOpenAI	54.0	5/7
16	GPT-5OpenAI	54.0	5/7
17	o1OpenAI	53.8	3/7
18	Grok 4xAI	50.8	3/7
19	Qwen3-235B-A22B-Instruct (Jul 2025)Alibaba	49.2	2/7
20	Qwen3 235B A22BAlibaba Qwen	48.4	2/7
21	DeepSeek V3DeepSeek	48.4	1/7
22	ZA GLM 5 Turboz-ai	48.2	1/7
23	ZA GLM 5z-ai	48.2	1/7
24	GPT-5 MiniOpenAI	48.1	3/7
25	M Kimi K2 0905moonshotai	47.9	2/7
26	ZA GLM 4.5z-ai	47.4	2/7
27	M Kimi K2 Thinkingmoonshotai	47.3	3/7
28	o4 MiniOpenAI	47.0	5/7
29	GPT-5.1OpenAI	47.0	4/7
30	GPT-5.1 ChatOpenAI	47.0	4/7
31	DeepSeek-R1DeepSeek	46.7	2/7
32	Claude Sonnet 4.5Anthropic	46.2	5/7
33	Grok 3 MinixAI	45.9	2/7
34	Grok 3 Mini BetaxAI	45.9	2/7
35	M Kimi K2.5moonshotai	45.6	1/7
36	Claude Opus 4Anthropic	45.6	5/7
37	Grok 3xAI	45.3	2/7
38	Grok 3 BetaxAI	45.3	2/7
39	Gemini 3 Flash PreviewGoogle DeepMind	45.2	3/7
40	Gemini 2.5 ProGoogle DeepMind	43.4	4/7
41	GPT-4.1OpenAI	43.3	4/7
42	Grok 4 FastxAI	42.9	1/7
43	Claude Sonnet 4Anthropic	42.4	5/7
44	Qwen3 235B A22B Thinking 2507Alibaba Qwen	41.0	1/7
45	Claude Opus 4.1Anthropic	39.6	3/7
46	Claude 3.7 SonnetAnthropic	39.1	5/7
47	Claude 3.7 Sonnet (thinking)Anthropic	39.1	5/7
48	Gemini 2.5 FlashGoogle DeepMind	38.9	3/7
49	DeepSeek V3.1DeepSeek	38.4	1/7
50	Gemini 2.0 FlashGoogle DeepMind	38.2	1/7

Other Skills