phi-3-medium 14B vs Mixtral 8x7B Instruct
Côte à côte. Chaque métrique. Chaque benchmark.
| Type | phi-3-medium 14B | Mixtral 8x7B Instruct |
|---|---|---|
| Provider |  Microsoft |  Mistral AI |
| score moyen | 58.6 | 57.8 |
| Prix d'entrée | - | $0.54 |
| Prix de sortie | - | $0.54 |
| Fenêtre de contexte | - | 33K tokens (~16 books) |
| Sorti le | 2024-01-01 | 2023-12-10 |
| Code source ouvert | Open Source | Open Source |
Scores de benchmark
9 benchmarks · phi-3-medium 14B: 6, Mixtral 8x7B Instruct: 3
| Benchmark | Catégorie | phi-3-medium 14B | Mixtral 8x7B Instruct |
|---|---|---|---|
| ANLI | knowledge | 33.7 | 32.8 |
| ARC AI2 | knowledge | 88.8 | 83.1 |
| GPQA diamond | knowledge | 3.5 | 7.5 |
| HellaSwag | knowledge | 76.5 | 82.3 |
| MATH level 5 | math | 17.6 | 9.9 |
| MMLU | knowledge | 70.7 | 60.8 |
| OpenBookQA | knowledge | 83.2 | 81.1 |
| TriviaQA | knowledge | 73.9 | 82.2 |
| Winogrande | knowledge | 63.0 | 54.4 |