Beta
Classement/phi-3-medium 14B
Microsoft

phi-3-medium 14B

Code source ouvert

par Microsoft · Sorti le 2024-01-01

58.6
score moyen
N/A
Prix d'entrée
N/A
Prix de sortie
N/A
Fenêtre de contexte
text
Type

Tested on 10 benchmarks with 58.6% average. Top scores: ARC AI2 (88.8%), OpenBookQA (83.2%), HellaSwag (76.5%).

Scores de benchmark

BenchmarkCatégorieScoreBar
ARC AI2knowledge88.8
OpenBookQAknowledge83.2
HellaSwagknowledge76.5
BBHreasoning75.2
TriviaQAknowledge73.9
MMLUknowledge70.7
Winograndeknowledge63.0
ANLIknowledge33.7
MATH level 5math17.6
GPQA diamondknowledge3.5

Modèles similaires

OpenAIGPT-5.4
OpenAI
59.1
T
Falcon 2 11B
TII
58.0
MetaLLaMA-33B
Meta
57.9
Mistral AIMixtral 8x7B Instruct
Mistral AI
57.8

Microsoft Phi 3 Chronologie

phi-3-medium 14B
58.6
N/AN/Actx10 benchmarks
phi-3-mini 3.8B
61.0+2.4
N/AN/Actx8 benchmarks
phi-3-small 7.4B
67.4+6.4
N/AN/Actx8 benchmarks