29.7
avg score
Rank #179
Better than 23% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text-generation
License
Open Source
Benchmarks
7 tested
Data updated today
About
Mistralai text generation model. 2753K downloads on HuggingFace.
Tested on 7 benchmarks with 18.5% average. Top scores: Chatbot Arena Elo — Overall (1148.3%), IFEval (55.0%), BBH (HuggingFace) (22.9%).
Capabilities
reasoning
7.6
#148 globally
math
3.0
#199 globally
knowledge
11.3
#206 globally
language
55.0
#98 globally
general
22.9
#37 globally
Benchmark Scores
Compare AllTested on 7 benchmarks · Ranked across 6 categories
Score Distribution (all 231 models)
0255075100
▲ You are here
reasoningCompare reasoning →
MUSR
7.6—HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.
mathCompare math →
MATH Level 5
3.0—HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.
knowledgeCompare knowledge →
MMLU-PRO
19.1—HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.
GPQA
3.5—HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.
vs Llama 3.3 70B Instruct (free)
vs Claude 3 Haiku Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Info
Research
Documentation
Community
Source Code
BenchGecko API
mistralai-mistral-7b-instruct-v02
Specifications
- Typetext-generation
- ContextN/A
- ReleasedDec 2023
- LicenseOpen Source
- StatusActive
Available On
Mistral AITBDLearn More
Share & Export
Frequently Asked Questions
Mistral 7B Instruct V0.2 is an open-source text-generation AI model by Mistral AI, released in December 2023. It has an average benchmark score of 29.7.