Mistral 7B Instruct v0.1
Open Sourcevon Mistral AI · Veroeffentlicht 2023-09-28
12.8
Durchschn. Score
$0.11/1M
Eingabepreis
$0.19/1M
Ausgabepreis
3K tokens (~1 books)
Kontextfenster
text
Typ
Tested on 6 benchmarks with 12.8% average. Top scores: IFEval (44.9%), MMLU-PRO (15.7%), BBH (HuggingFace) (7.7%).
Benchmark-Ergebnisse
| Benchmark | Kategorie | Score | Bar |
|---|---|---|---|
| IFEval | language | 44.9 | |
| MMLU-PRO | knowledge | 15.7 | |
| BBH (HuggingFace) | general | 7.7 | |
| MUSR | reasoning | 6.1 | |
| MATH Level 5 | math | 2.3 | |
| GPQA | knowledge | 0.0 |