CodeR
28.3
best score
28.3%
Best Score
lite
Best Leaderboard
1
Models Used
Yes
Open Source
Score History
| Entry | Score |
|---|---|
| EntroPO + R2E + Qwen3-Coder-30B-A3B-Instruct | 60.4% |
| EntroPO + R2E + Qwen3-Coder-30B-A3B-Instruct | 52.2% |
| EntroPO + R2E + Qwen3-Coder-30B-A3B-Instruct | 49.7% |
| EntroPO + R2E + Qwen3-Coder-30B-A3B-Instruct | 45.0% |
| ACoder | 76.4% |
| OpenHands + Qwen3-Coder-480B-A35B-Instruct | 69.6% |
| OpenHands + Qwen3-Coder-30B-A3B-Instruct | 51.6% |
| Qwen2.5-Coder 32B Instruct | 9.0% |
| mini-SWE-agent + Qwen2.5-Coder 32B Instruct | 9.0% |
| Qwen3-Coder 480B/A35B Instruct | 55.4% |
| mini-SWE-agent + Qwen3-Coder 480B/A35B Instruct | 55.4% |
| Aime-coder v1 + Anthopic Claude 3.7 Sonnet | 66.4% |
| Zencoder (2025-04-30) | 70.0% |
| Zencoder (2025-04-01) | 30.6% |
| Zencoder (2025-03-10) | 27.1% |
| AutoCodeRover-v2.1 (Claude-3.5-Sonnet-20241022) | 51.6% |
| OpenCSG Starship Agentic Coder + GPT 4 (0806) | 39.7% |
| AutoCodeRover-v2.0 (Claude-3.5-Sonnet-20241022) | 24.9% |
| AutoCodeRover-v2.0 (Claude-3.5-Sonnet-20241022) | 46.2% |
| AIGCode Infant-Coder(2024-08-30) | 30.0% |
| SuperCoder2.0 | 34.0% |
| AutoCodeRover (v20240620) + GPT 4o (2024-05-13) | 18.8% |
| AutoCodeRover (v20240620) + GPT 4o (2024-05-13) | 38.4% |
| AutoCodeRover (v20240620) + GPT 4o (2024-05-13) | 30.7% |
| CodeR + GPT 4 (1106) | 28.3% |
| AutoCodeRover (v20240408) + GPT 4 (0125) | 19.0% |