Benchmark · CodeSettled

Aider polyglot

Aider Polyglot · measures how well AI models can edit code across multiple programming languages using the Aider coding assistant framework.

Updated 2025-12-01
Models tested
56
Top score
88.0
GPT-5 Chat
Median
52.8
min 3.6
Top-5 spread
σ 2.2
Competitive

Best score over time · one chart, every benchmark

AIDER POLYGLOT40 MODELS · FRONTIER RUNNING MAX0255075100SCORE ↑Nov 24Feb 25May 25Aug 25Dec 25RELEASE DATE →benchgecko.ai/benchmark/aider-polyglot · frontier
Frontier on Aider polyglot rose from 61.7 to 88.0 in 8 months · +26.3 points · latest leader GPT-5 Chat from OpenAI.
Pink dots = frontier records · 6 totalClick to open model page

56 models tested · sorted by score

#ModelScore
1OpenAI logoGPT-5 Chat88.0
2OpenAI logoGPT-588.0
3OpenAI logoo3 Pro84.9
4Google DeepMind logoGemini 2.5 Pro83.1
5Google DeepMind logoGemini 2.5 Pro Preview 06-0583.1
6OpenAI logoo381.3
7xAI logoGrok 479.6
8Google DeepMind logoGemini 2.5 Pro Preview 05-0676.9
9DeepSeek logoDeepSeek V3.274.2
10DeepSeek logoDeepSeek V3.2 Exp74.2
11Anthropic logoClaude Opus 472.0
12OpenAI logoo4 Mini72.0
13OpenAI logoo4 Mini High72.0
14OpenAI logoo4 Mini (batch)72.0
15DeepSeek logoR1 052871.4
16Anthropic logoClaude 3.7 Sonnet64.9
17OpenAI logoo161.7
18Anthropic logoClaude Sonnet 461.3
19OpenAI logoo3 Mini (batch)60.4
20OpenAI logoo3 Mini High60.4
21OpenAI logoo3 Mini60.4
22Alibaba Qwen logoQwen3 235B A22B59.6
23Alibaba Qwen logoQwen3 235B A22B Instruct 250759.6
24moonshotai logoKimi K2 071159.1
25DeepSeek logoR156.9
26DeepSeek logoDeepSeek V3 032455.1
27xAI logoGrok 3 Beta53.3
28xAI logoGrok 353.3
29OpenAI logoGPT-4.152.4
30Anthropic logoClaude 3.5 Sonnet51.6
31xAI logoGrok 3 Mini Beta49.3
32xAI logoGrok-3 mini49.3
33DeepSeek logoDeepSeek V348.4
34Google DeepMind logoGemini 2.5 Flash47.1
35OpenAI logoGPT-4.544.9
36OpenAI logogpt-oss-120b41.8
37OpenAI logogpt-oss-120b (free)41.8
38Alibaba Qwen logoQwen3 32B40.0
39Google DeepMind logoGemini 2.0 Flash (Dec 2024)38.2
40Google DeepMind logoGemini 2.0 Flash38.2
41Google DeepMind logoGemini 2.0 Pro35.6
42OpenAI logoo1-mini32.9
43OpenAI logoGPT-4.1 Mini32.4
44Anthropic logoClaude 3.5 Haiku28.0
45OpenAI logoGPT-4o (2024-11-20)23.1
46OpenAI logoGPT-4o (2024-08-06)23.1
47Alibaba Qwen logoQwen2.5-Max21.8
48Alibaba Qwen logoQwQ 32B20.9
49Google DeepMind logoGemini 2.0 Flash Thinking (Jan 2025)18.2
50Alibaba Qwen logoQwen2.5 Coder 32B Instruct16.4
51Meta logoLlama 4 Maverick15.6
52OpenAI logoGPT-4.1 Nano8.9
53Google DeepMind logoGemma 3 27B4.9
54Google DeepMind logoGemma 3 27B (free)4.9
55OpenAI logoGPT-4o-mini (2024-07-18)3.6
56OpenAI logoGPT-4o-mini3.6

Same category · related evaluations