Mixtral 8x22B Instruct
Open Sourcedi Mistral AI · Rilascio 2024-04-17
23.5
punteggio medio
$2.00/1M
Prezzo Input
$6.00/1M
Prezzo Output
66K tokens (~33 books)
Finestra di Contesto
text
Tipo
Tested on 5 benchmarks with 23.5% average. Top scores: MMLU (70.4%), MATH level 5 (24.2%), GPQA diamond (12.1%).
Punteggi Benchmark
| Benchmark | Categoria | Punteggio | Bar |
|---|---|---|---|
| MMLU | knowledge | 70.4 | |
| MATH level 5 | math | 24.2 | |
| GPQA diamond | knowledge | 12.1 | |
| Cybench | coding | 7.5 | |
| WeirdML | coding | 3.2 |