Mistral Large 2407
C贸digo abiertopor Mistral AI 路 Publicado el 2024-11-19
39.1
puntuaci贸n promedio
$2.00/1M
Precio de entrada
$6.00/1M
Precio de salida
131K tokens (~66 books)
Ventana de contexto
text
Tipo
Tested on 6 benchmarks with 39.1% average. Top scores: MMLU (73.3%), Lech Mazur Writing (69.0%), MATH level 5 (44.8%).
Puntuaciones de benchmark
| Benchmark | Categor铆a | Puntuaci贸n | Bar |
|---|---|---|---|
| MMLU | knowledge | 73.3 | |
| Lech Mazur Writing | knowledge | 69.0 | |
| MATH level 5 | math | 44.8 | |
| GPQA diamond | knowledge | 32.0 | |
| OTIS Mock AIME 2024-2025 | math | 8.4 | |
| SimpleBench | reasoning | 7.0 |