Mistral Large
Open Sourcevon Mistral AI · Veroeffentlicht 2024-02-26
30.0
Durchschn. Score
$2.00/1M
Eingabepreis
$6.00/1M
Ausgabepreis
128K tokens (~64 books)
Kontextfenster
text
Typ
Tested on 8 benchmarks with 30.0% average. Top scores: Lech Mazur Writing (69.0%), Aider — Code Editing (60.2%), MMLU (58.4%).
Benchmark-Ergebnisse
| Benchmark | Kategorie | Score | Bar |
|---|---|---|---|
| Lech Mazur Writing | knowledge | 69.0 | |
| Aider — Code Editing | coding | 60.2 | |
| MMLU | knowledge | 58.4 | |
| MATH level 5 | math | 24.5 | |
| GPQA diamond | knowledge | 18.4 | |
| SimpleBench | reasoning | 7.0 | |
| OTIS Mock AIME 2024-2025 | math | 1.9 | |
| FrontierMath-2025-02-28-Private | math | 0.3 |