Qwen2.5 7B Instruct
Open Sourcevon Alibaba Qwen · Veroeffentlicht 2024-10-16
35.2
Durchschn. Score
$0.04/1M
Eingabepreis
$0.10/1M
Ausgabepreis
33K tokens (~16 books)
Kontextfenster
text
Typ
Tested on 6 benchmarks with 35.2% average. Top scores: IFEval (75.8%), MATH Level 5 (50.0%), MMLU-PRO (36.5%).
Benchmark-Ergebnisse
| Benchmark | Kategorie | Score | Bar |
|---|---|---|---|
| IFEval | language | 75.8 | |
| MATH Level 5 | math | 50.0 | |
| MMLU-PRO | knowledge | 36.5 | |
| BBH (HuggingFace) | general | 34.9 | |
| MUSR | reasoning | 8.4 | |
| GPQA | knowledge | 5.5 |