GPT-3.5 Turbo (older v0613) vs phi-3-small 7.4B
Lado a lado. Cada métrica. Cada benchmark.
| Tipo | GPT-3.5 Turbo (older v0613) | phi-3-small 7.4B |
|---|---|---|
| Provider |  OpenAI |  Microsoft |
| puntuación promedio | 45.8 | 67.4 |
| Precio de entrada | $1.00 | - |
| Precio de salida | $2.00 | - |
| Ventana de contexto | 4K tokens (~2 books) | - |
| Publicado el | 2024-01-25 | 2024-01-01 |
| Código abierto | Proprietary | Open Source |
Puntuaciones de benchmark
7 benchmarks · GPT-3.5 Turbo (older v0613): 2, phi-3-small 7.4B: 4
| Benchmark | Categoría | GPT-3.5 Turbo (older v0613) | phi-3-small 7.4B |
|---|---|---|---|
| ANLI | knowledge | 37.1 | 37.1 |
| ARC AI2 | knowledge | 83.2 | 87.6 |
| BBH | reasoning | 48.8 | 72.1 |
| MMLU | knowledge | 56.4 | 67.6 |
| OpenBookQA | knowledge | 81.3 | 84.0 |
| TriviaQA | knowledge | 85.8 | 58.1 |
| Winogrande | knowledge | 63.2 | 63.0 |