Beta
Leaderboard/phi-3-medium 14B
Microsoft

phi-3-medium 14B

Open Source

by Microsoft 路 Released 2024-01-01

58.6
avg score
N/A
Input Price
N/A
Output Price
N/A
Context Window
text
Type

Tested on 10 benchmarks with 58.6% average. Top scores: ARC AI2 (88.8%), OpenBookQA (83.2%), HellaSwag (76.5%).

Benchmark Scores

BenchmarkCategoryScoreBar
ARC AI2knowledge88.8
OpenBookQAknowledge83.2
HellaSwagknowledge76.5
BBHreasoning75.2
TriviaQAknowledge73.9
MMLUknowledge70.7
Winograndeknowledge63.0
ANLIknowledge33.7
MATH level 5math17.6
GPQA diamondknowledge3.5

Similar Models

OpenAIGPT-5.4
OpenAI
59.1
T
Falcon 2 11B
TII
58.0
MetaLLaMA-33B
Meta
57.9
Mistral AIMixtral 8x7B Instruct
Mistral AI
57.8

Microsoft Phi 3 Timeline

phi-3-medium 14B
58.6
N/AN/Actx10 benchmarks
phi-3-mini 3.8B
61.0+2.4
N/AN/Actx8 benchmarks
phi-3-small 7.4B
67.4+6.4
N/AN/Actx8 benchmarks