Mistral Small 3.1 24B
Open Sourcedi Mistral AI · Rilascio 2025-03-17
55.8
punteggio medio
$0.35/1M
Prezzo Input
$0.56/1M
Prezzo Output
128K tokens (~64 books)
Finestra di Contesto
multimodal
Tipo
Tested on 5 benchmarks with 55.8% average. Top scores: HELM — WildBench (78.8%), HELM — IFEval (75.0%), HELM — MMLU-Pro (61.0%).
Punteggi Benchmark
| Benchmark | Categoria | Punteggio | Bar |
|---|---|---|---|
| HELM — WildBench | reasoning | 78.8 | |
| HELM — IFEval | language | 75.0 | |
| HELM — MMLU-Pro | knowledge | 61.0 | |
| HELM — GPQA | knowledge | 39.2 | |
| HELM — Omni-MATH | math | 24.8 |
Modelli Simili
Alibaba Qwen
55.9
OpenAI
56.0
DeepSeek
56.0
OpenAI
56.2