68.2
avg score
Rank #56
Better than 80% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text
License
Open Source
Benchmarks
11 tested
Data updated today
About
Tested on 11 benchmarks with 57.8% average. Top scores: ARC AI2 (83.1%), HellaSwag (82.3%), TriviaQA (82.2%).
Capabilities
math
42.2
#118 globally
knowledge
61.3
#52 globally
Benchmark Scores
Compare AllTested on 11 benchmarks · Ranked across 2 categories
Score Distribution (all 274 models)
0255075100
▲ You are here
mathCompare math →
GSM8K
74.4—Grade school math word problems. 8,500 problems testing multi-step arithmetic reasoning. A foundational math benchmark.
MATH level 5
9.9—Competition-level math from AMC, AIME, and olympiad problems. Level 5 is the hardest tier, requiring creative problem-solving.
knowledgeCompare knowledge →
ARC AI2
83.1—AI2 Reasoning Challenge. Grade-school science questions requiring multi-step reasoning. Easy and Challenge sets test different difficulty levels.
HellaSwag
82.3—Sentence completion requiring commonsense reasoning about physical and social situations. Tests real-world understanding.
TriviaQA
82.2—Trivia questions sourced from trivia enthusiasts and quiz websites. Tests breadth of general knowledge.
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Research
Documentation
Community
Source Code
BenchGecko API
mixtral-8x7b
Specifications
- Typetext
- ContextN/A
- ReleasedJan 2024
- LicenseOpen Source
- Statusbenchmark-only
Available On
Learn More
Share & Export
Frequently Asked Questions
Mixtral 8x7B is an open-source text AI model by Mistral AI, released in January 2024. It has an average benchmark score of 68.2.