Qwen2.5 1.5B Instruct
Open Sourcevon Alibaba · Veroeffentlicht 2024-09-17
18.4
Durchschn. Score
N/A
Eingabepreis
N/A
Ausgabepreis
N/A
Kontextfenster
text-generation
Typ
Tested on 6 benchmarks with 18.4% average. Top scores: IFEval (44.8%), MATH Level 5 (22.1%), MMLU-PRO (20.0%).
Benchmark-Ergebnisse
| Benchmark | Kategorie | Score | Bar |
|---|---|---|---|
| IFEval | language | 44.8 | |
| MATH Level 5 | math | 22.1 | |
| MMLU-PRO | knowledge | 20.0 | |
| BBH (HuggingFace) | general | 19.8 | |
| MUSR | reasoning | 3.2 | |
| GPQA | knowledge | 0.8 |
Aehnliche Modelle
Mistral AI
18.5
z-ai
18.0
Meta
18.9
DeepSeek
16.7