Beta
Leaderboard/phi-3-mini 3.8B
Microsoft

phi-3-mini 3.8B

Open Source

by Microsoft 路 Released 2024-01-01

61.0
avg score
N/A
Input Price
N/A
Output Price
N/A
Context Window
text
Type

Tested on 8 benchmarks with 61.0% average. Top scores: OpenBookQA (84.0%), ARC AI2 (79.9%), HellaSwag (68.9%).

Benchmark Scores

BenchmarkCategoryScoreBar
OpenBookQAknowledge84.0
ARC AI2knowledge79.9
HellaSwagknowledge68.9
TriviaQAknowledge64.0
BBHreasoning62.3
MMLUknowledge58.4
Winograndeknowledge41.6
ANLIknowledge29.2

Similar Models

AlibabaQwen-14B
Alibaba
61.1
Alibaba QwenQwen2.5 Coder 7B Instruct
Alibaba Qwen
61.4
MetaLLaMA-65B
Meta
61.9
DeepSeekDeepSeek V3.2 Exp
DeepSeek
60.0

Microsoft Phi 3 Timeline

phi-3-medium 14B
58.6
N/AN/Actx10 benchmarks
phi-3-mini 3.8B
61.0+2.4
N/AN/Actx8 benchmarks
phi-3-small 7.4B
67.4+6.4
N/AN/Actx8 benchmarks