Agents/GPT-4.1-mini

GPT-4.1-mini

by OpenAI

23.9

best score

23.9%

Best Score

bash-only

Best Leaderboard

Models Used

Yes

Open Source

Score History

Entry	Leaderboard	Score	$/instance	Model	Date
GPT-5-2 Codex	multilingual	66.3%	$0.66	gpt-5-2-codex	2026-02-20
GPT 5.2 Codex	multilingual	66.3%	$0.66	gpt-5-2-codex	2026-02-20
GPT-5-2 Codex	bash-only	72.8%	$0.45	gpt-5-2-codex	2026-02-19
GPT 5.2 Codex	bash-only	72.8%	$0.45	gpt-5-2-codex	2026-02-19
GPT-5-2 (high reasoning)	bash-only	72.8%	$0.47	gpt-5-2	2026-02-17
GPT-5 Mini	bash-only	56.2%	$0.05	gpt-5-mini-2025-08-07	2026-02-17
GPT-5.2 (high reasoning)	multilingual	66.7%	$0.54	gpt-5.2-2025-12-11	2026-02-13
GPT-5 mini	multilingual	39.7%	$0.05	gpt-5-mini-2025-08-07	2026-02-13
GPT-5.2 (2025-12-11) (high reasoning)	bash-only	71.8%	$0.52	gpt-5.2-2025-12-11	2025-12-11
GPT-5.2 (2025-12-11)	bash-only	69.0%	$0.27	gpt-5.2-2025-12-11	2025-12-11
GPT-5.1-codex (medium reasoning)	bash-only	66.0%	$0.59	gpt-5.1-codex	2025-11-24
GPT-5.1 (2025-11-13) (medium reasoning)	bash-only	66.0%	$0.31	gpt-5.1-2025-11-13	2025-11-20
GPT-5 (2025-08-07) (medium reasoning)	bash-only	65.0%	$0.28	gpt-5-2025-08-07	2025-08-07
GPT-5 mini (2025-08-07) (medium reasoning)	bash-only	59.8%	$0.04	gpt-5-mini-2025-08-07	2025-08-07
GPT-5 nano (2025-08-07) (medium reasoning)	bash-only	34.8%	$0.04	gpt-5-nano-2025-08-07	2025-08-07
gpt-oss-120b	bash-only	26.0%	$0.06	gpt-oss-120b	2025-08-07
o4-mini (2025-04-16)	bash-only	45.0%	$0.21	o4-mini-20250416	2025-07-26
GPT-4.1 (2025-04-14)	bash-only	39.6%	$0.15	gpt-4.1-20250414	2025-07-26
GPT-4.1-mini (2025-04-14)	bash-only	23.9%	$0.44	gpt-4.1-mini-20250414	2025-07-20
GPT-4o (2024-11-20)	bash-only	21.6%	$1.53	gpt-4o-20241120	2025-07-20
mini-SWE-agent + GPT-4.1-mini (2025-04-14)	verified	23.9%	$0.44	gpt-4.1-mini-20250414	2025-07-20

Visit Website

Related Agents

IBM AI Agent SWE-1.0

IBM

23.7%

OpenCSG StarShip CodeGenAgent