Qwen2.5 Coder 7B Instruct
오픈소스제공 Alibaba Qwen · 출시일 2025-04-15
44.4
평균 점수
$0.03/1M
입력 가격
$0.09/1M
출력 가격
33K tokens (~16 books)
컨텍스트 윈도우
text
유형
Tested on 12 benchmarks with 44.4% average. Top scores: GSM8K (86.7%), HellaSwag (69.1%), IFEval (61.0%).
벤치마크 점수
| 벤치마크 | 카테고리 | 점수 | Bar |
|---|---|---|---|
| GSM8K | math | 86.7 | |
| HellaSwag | knowledge | 69.1 | |
| IFEval | language | 61.0 | |
| Aider — Code Editing | coding | 57.9 | |
| MMLU | knowledge | 57.3 | |
| ARC AI2 | knowledge | 47.9 | |
| Winogrande | knowledge | 45.8 | |
| MATH Level 5 | math | 37.2 | |
| BBH (HuggingFace) | general | 28.9 | |
| MMLU-PRO | knowledge | 26.1 | |
| MUSR | reasoning | 9.5 | |
| GPQA | knowledge | 5.6 |