Beta
Leaderboard/Mistral Large
Mistral AI

Mistral Large

Open Source

by Mistral AI 路 Released 2024-02-26

25.8
avg score
$2.00/1M
Input Price
$6.00/1M
Output Price
128K tokens (~64 books)
Context Window
text
Type

Tested on 4 benchmarks with 25.8% average. Top scores: MMLU (58.4%), MATH level 5 (24.5%), GPQA diamond (18.4%).

Benchmark Scores

BenchmarkCategoryScoreBar
MMLUknowledge58.4
MATH level 5math24.5
GPQA diamondknowledge18.4
OTIS Mock AIME 2024-2025math1.9

Similar Models

MetaLlama 3.1 70B Instruct
Meta
26.1
DeepSeekDeepSeek Coder 33B
DeepSeek
25.4
MicrosoftPhi-1.5
Microsoft
27.2
U
Baichuan1-7B
unknown
23.7

Mistral AI Mistral Large Timeline

Mistral Large
25.8
$2.00/M in128Kctx4 benchmarks
Mistral Large 2407
39.1+13.3
$2.00/M in131Kctx(+3K)6 benchmarks
Mistral Large 2411
23.4-15.7
$2.00/M in131Kctx4 benchmarks
Mistral Large 3 2512
$0.50/M in(-1.50)262Kctx(+131K)