Phi 3.5 Mini Instruct
Código abiertopor Microsoft · Publicado el 2024-08-16
28.2
puntuación promedio
N/A
Precio de entrada
N/A
Precio de salida
N/A
Ventana de contexto
text-generation
Tipo
Tested on 6 benchmarks with 28.2% average. Top scores: IFEval (57.8%), BBH (HuggingFace) (36.8%), MMLU-PRO (32.9%).
Puntuaciones de benchmark
| Benchmark | Categoría | Puntuación | Bar |
|---|---|---|---|
| IFEval | language | 57.8 | |
| BBH (HuggingFace) | general | 36.8 | |
| MMLU-PRO | knowledge | 32.9 | |
| MATH Level 5 | math | 19.6 | |
| GPQA | knowledge | 12.0 | |
| MUSR | reasoning | 10.1 |
Modelos similares
Claude 3 SonnetAnthropic
28.3
D
Dolphin 2.9.1 Yi 1.5 34bDPHN
28.3
Llama 4 MaverickMeta
28.0
Magnum v4 72Banthracite-org
27.9