phi-3-medium 14B vs phi-3-small 7.4B
Lado a lado. Cada métrica. Cada benchmark.
| Tipo | phi-3-medium 14B | phi-3-small 7.4B |
|---|---|---|
| Provider |  Microsoft | Microsoft |
| puntuación promedio | 58.6 | 67.4 |
| Precio de entrada | - | - |
| Precio de salida | - | - |
| Ventana de contexto | - | - |
| Publicado el | 2024-01-01 | 2024-01-01 |
| Código abierto | Open Source | Open Source |
Puntuaciones de benchmark
8 benchmarks · phi-3-medium 14B: 5, phi-3-small 7.4B: 2
| Benchmark | Categoría | phi-3-medium 14B | phi-3-small 7.4B |
|---|---|---|---|
| ANLI | knowledge | 33.7 | 37.1 |
| ARC AI2 | knowledge | 88.8 | 87.6 |
| BBH | reasoning | 75.2 | 72.1 |
| HellaSwag | knowledge | 76.5 | 69.3 |
| MMLU | knowledge | 70.7 | 67.6 |
| OpenBookQA | knowledge | 83.2 | 84.0 |
| TriviaQA | knowledge | 73.9 | 58.1 |
| Winogrande | knowledge | 63.0 | 63.0 |