U
Muse Spark
por Unknown · Publicado el 2024-01-01
59.0
puntuación promedio
N/A
Precio de entrada
N/A
Precio de salida
N/A
Ventana de contexto
text
Tipo
Tested on 8 benchmarks with 59.0% average. Top scores: OTIS Mock AIME 2024-2025 (88.9%), GPQA diamond (86.4%), SimpleQA Verified (66.3%).
Puntuaciones de benchmark
| Benchmark | Categoría | Puntuación | Bar |
|---|---|---|---|
| OTIS Mock AIME 2024-2025 | math | 88.9 | |
| GPQA diamond | knowledge | 86.4 | |
| SimpleQA Verified | knowledge | 66.3 | |
| Artificial Analysis — Agentic Index | speed | 62.0 | |
| Artificial Analysis — Quality Index | speed | 52.1 | |
| Artificial Analysis — Coding Index | speed | 47.5 | |
| FrontierMath-2025-02-28-Private | math | 39.0 | |
| FrontierMath-Tier-4-2025-07-01-Private | math | 14.6 |
