Qwen2.5 Coder 7B Instruct
Open Sourcedi Alibaba Qwen · Rilascio 2025-04-15
44.4
punteggio medio
$0.03/1M
Prezzo Input
$0.09/1M
Prezzo Output
33K tokens (~16 books)
Finestra di Contesto
text
Tipo
Tested on 12 benchmarks with 44.4% average. Top scores: GSM8K (86.7%), HellaSwag (69.1%), IFEval (61.0%).
Punteggi Benchmark
| Benchmark | Categoria | Punteggio | Bar |
|---|---|---|---|
| GSM8K | math | 86.7 | |
| HellaSwag | knowledge | 69.1 | |
| IFEval | language | 61.0 | |
| Aider — Code Editing | coding | 57.9 | |
| MMLU | knowledge | 57.3 | |
| ARC AI2 | knowledge | 47.9 | |
| Winogrande | knowledge | 45.8 | |
| MATH Level 5 | math | 37.2 | |
| BBH (HuggingFace) | general | 28.9 | |
| MMLU-PRO | knowledge | 26.1 | |
| MUSR | reasoning | 9.5 | |
| GPQA | knowledge | 5.6 |