Beta
Clasificaci贸n/phi-3-medium 14B
Microsoft

phi-3-medium 14B

C贸digo abierto

por Microsoft 路 Publicado el 2024-01-01

58.6
puntuaci贸n promedio
N/A
Precio de entrada
N/A
Precio de salida
N/A
Ventana de contexto
text
Tipo

Tested on 10 benchmarks with 58.6% average. Top scores: ARC AI2 (88.8%), OpenBookQA (83.2%), HellaSwag (76.5%).

Puntuaciones de benchmark

BenchmarkCategor铆aPuntuaci贸nBar
ARC AI2knowledge88.8
OpenBookQAknowledge83.2
HellaSwagknowledge76.5
BBHreasoning75.2
TriviaQAknowledge73.9
MMLUknowledge70.7
Winograndeknowledge63.0
ANLIknowledge33.7
MATH level 5math17.6
GPQA diamondknowledge3.5

Modelos similares

OpenAIGPT-5.4
OpenAI
59.1
T
Falcon 2 11B
TII
58.0
MetaLLaMA-33B
Meta
57.9
Mistral AIMixtral 8x7B Instruct
Mistral AI
57.8

Microsoft Phi 3 Cronolog铆a

phi-3-medium 14B
58.6
N/AN/Actx10 benchmarks
phi-3-mini 3.8B
61.0+2.4
N/AN/Actx8 benchmarks
phi-3-small 7.4B
67.4+6.4
N/AN/Actx8 benchmarks