Phi 2 vs StarCoder 2 15B
Lado a lado. Cada métrica. Cada benchmark.
| Tipo | Phi 2 | StarCoder 2 15B |
|---|---|---|
| Provider |  Microsoft | U Unknown |
| puntuación promedio | 30.2 | 24.3 |
| Precio de entrada | - | - |
| Precio de salida | - | - |
| Ventana de contexto | - | - |
| Publicado el | 2023-12-13 | 2024-01-01 |
| Código abierto | Open Source | Open Source |
Puntuaciones de benchmark
9 benchmarks · Phi 2: 4, StarCoder 2 15B: 5
| Benchmark | Categoría | Phi 2 | StarCoder 2 15B |
|---|---|---|---|
| ARC AI2 | knowledge | 67.9 | 29.6 |
| BBH (HuggingFace) | general | 28.0 | 20.4 |
| GPQA | knowledge | 2.9 | 3.1 |
| IFEval | language | 27.4 | 27.8 |
| MATH Level 5 | math | 3.0 | 6.0 |
| MMLU | knowledge | 44.5 | 52.1 |
| MMLU-PRO | knowledge | 18.1 | 15.0 |
| MUSR | reasoning | 13.8 | 2.9 |
| Winogrande | knowledge | 9.4 | 28.6 |