Providers Countries MCP Servers Capabilities AI Pulse News Calculator Model Status

Agents/Claude 4.5 Opus medium

Claude 4.5 Opus medium

by Anthropic

74.4

best score

74.4%

Best Score

bash-only

Best Leaderboard

1

Models Used

Yes

Open Source

Score History

Entry	Leaderboard	Score	$/instance	Model	Date
Claude 4.5 Opus (high reasoning)	bash-only	76.8%	$0.75	claude-4-5-opus	2026-02-17
Claude Opus 4.6	bash-only	75.6%	$0.55	claude-opus-4-6	2026-02-17
Claude 4.5 Sonnet (high reasoning)	bash-only	71.4%	$0.66	claude-sonnet-4-5-20250929	2026-02-17
Claude 4.5 Haiku (high reasoning)	bash-only	66.6%	$0.33	claude-haiku-4-5-20251001	2026-02-17
Claude 4.6 Opus	multilingual	72.0%	$0.66	claude-opus-4-6	2026-02-13
Claude 4.5 Opus	multilingual	70.7%	$0.83	claude-opus-4-5-20251101	2026-02-13
Claude 4.5 Sonnet	multilingual	67.0%	$0.67	claude-sonnet-4-5-20250929	2026-02-13
Claude 4.5 Haiku	multilingual	64.7%	$0.38	claude-haiku-4-5-20251001	2026-02-13
live-SWE-agent + Claude 4.5 Opus medium (20251101)	verified	79.2%	-	claude-opus-4-5-20251101	2025-12-15
Claude 4.5 Opus medium (20251101)	bash-only	74.4%	$0.72	claude-opus-4-5-20251101	2025-11-24
mini-SWE-agent + Claude 4.5 Opus medium (20251101)	verified	74.4%	$0.72	claude-opus-4-5-20251101	2025-11-24
Claude 4.5 Sonnet (20250929)	bash-only	70.6%	$0.56	claude-sonnet-4-5-20250929	2025-09-29
Claude 4 Opus (20250514)	bash-only	67.6%	$1.13	claude-4-opus-20250514	2025-08-02
Claude 4 Sonnet (20250514)	bash-only	64.9%	$0.37	claude-4-sonnet-20250514	2025-07-26
Claude 3.7 Sonnet (20250219)	bash-only	52.8%	$0.35	claude-3-7-sonnet-20250219	2025-07-20
Tools + Claude 3.7 Sonnet (2025-02-24)	verified	63.2%	-	-	2025-02-24
Tools + Claude 3.5 Sonnet (2024-10-22)	verified	49.0%	-	claude-3.5-sonnet-20241022	2024-10-22
Tools + Claude 3.5 Haiku	verified	40.6%	-	claude-3-haiku-20240307	2024-10-22

Related Agents

Refact.ai Agent

Prometheus-v1.2.1

Lingxi-v1.5_claude-4-sonnet-20250514