Mistral 7B Instruct v0.1
Open Sourcedi Mistral AI · Rilascio 2023-09-28
12.8
punteggio medio
$0.11/1M
Prezzo Input
$0.19/1M
Prezzo Output
3K tokens (~1 books)
Finestra di Contesto
text
Tipo
Tested on 6 benchmarks with 12.8% average. Top scores: IFEval (44.9%), MMLU-PRO (15.7%), BBH (HuggingFace) (7.7%).
Punteggi Benchmark
| Benchmark | Categoria | Punteggio | Bar |
|---|---|---|---|
| IFEval | language | 44.9 | |
| MMLU-PRO | knowledge | 15.7 | |
| BBH (HuggingFace) | general | 7.7 | |
| MUSR | reasoning | 6.1 | |
| MATH Level 5 | math | 2.3 | |
| GPQA | knowledge | 0.0 |