Beta
Compare · ModelsLive · 2 picked · head to head

DeepSeek-V2 (MoE-236B, May 2024) vs Mixtral 8x7B Instruct

Side by side · benchmarks, pricing, and signals you can act on.

Winner summary

DeepSeek-V2 (MoE-236B, May 2024) wins 5 of 6 shared benchmarks. Leads in knowledge.

Category leads
knowledge·DeepSeek-V2 (MoE-236B, May 2024)
Hype vs Reality
DeepSeek-V2 (MoE-236B, May 2024)
#8 by perf·no signal
QUIET
Mixtral 8x7B Instruct
#52 by perf·no signal
QUIET
Best value
DeepSeek-V2 (MoE-236B, May 2024)
no price
Mixtral 8x7B Instruct
107.0 pts/$
$0.54/M
Vendor risk
One or more vendors flagged
DeepSeek logo
DeepSeek
$3.4B·Tier 1
Higher risk
Mistral AI logo
Mistral AI
$14.0B·Tier 1
Medium risk
Head to head
DeepSeek-V2 (MoE-236B, May 2024)Mixtral 8x7B Instruct
ARC AI2
DeepSeek-V2 (MoE-236B, May 2024) leads by +6.5
AI2 Reasoning Challenge · tests grade-school level science knowledge with multiple-choice questions requiring reasoning beyond simple retrieval.
DeepSeek-V2 (MoE-236B, May 2024)
89.6
Mixtral 8x7B Instruct
83.1
HellaSwag
DeepSeek-V2 (MoE-236B, May 2024) leads by +0.5
HellaSwag · tests commonsense reasoning by asking models to predict the most plausible continuation of everyday scenarios.
DeepSeek-V2 (MoE-236B, May 2024)
82.8
Mixtral 8x7B Instruct
82.3
MMLU
DeepSeek-V2 (MoE-236B, May 2024) leads by +10.4
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
DeepSeek-V2 (MoE-236B, May 2024)
71.2
Mixtral 8x7B Instruct
60.8
PIQA
DeepSeek-V2 (MoE-236B, May 2024) leads by +0.6
PIQA (Physical Interaction QA) · tests intuitive physical reasoning by asking models to select the correct approach for everyday physical tasks.
DeepSeek-V2 (MoE-236B, May 2024)
67.8
Mixtral 8x7B Instruct
67.2
TriviaQA
Mixtral 8x7B Instruct leads by +2.2
TriviaQA · reading comprehension benchmark with trivia questions, requiring models to find and reason over evidence from provided documents.
DeepSeek-V2 (MoE-236B, May 2024)
80.0
Mixtral 8x7B Instruct
82.2
Winogrande
DeepSeek-V2 (MoE-236B, May 2024) leads by +18.2
WinoGrande · large-scale commonsense reasoning benchmark where models must resolve ambiguous pronouns in carefully constructed sentence pairs.
DeepSeek-V2 (MoE-236B, May 2024)
72.6
Mixtral 8x7B Instruct
54.4
Full benchmark table
BenchmarkDeepSeek-V2 (MoE-236B, May 2024)Mixtral 8x7B Instruct
ARC AI2
AI2 Reasoning Challenge · tests grade-school level science knowledge with multiple-choice questions requiring reasoning beyond simple retrieval.
89.683.1
HellaSwag
HellaSwag · tests commonsense reasoning by asking models to predict the most plausible continuation of everyday scenarios.
82.882.3
MMLU
Massive Multitask Language Understanding · 57 subjects spanning STEM, humanities, social sciences, and more. The standard benchmark for broad knowledge.
71.260.8
PIQA
PIQA (Physical Interaction QA) · tests intuitive physical reasoning by asking models to select the correct approach for everyday physical tasks.
67.867.2
TriviaQA
TriviaQA · reading comprehension benchmark with trivia questions, requiring models to find and reason over evidence from provided documents.
80.082.2
Winogrande
WinoGrande · large-scale commonsense reasoning benchmark where models must resolve ambiguous pronouns in carefully constructed sentence pairs.
72.654.4
Pricing · per 1M tokens · projected $/mo at 10M tokens
ModelInputOutputContextProjected $/mo
DeepSeek logoDeepSeek-V2 (MoE-236B, May 2024)
Mistral AI logoMixtral 8x7B Instruct$0.54$0.5433K tokens (~16 books)$5.40