Better than 65% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text-generation
License
Open Source
Benchmarks
7 tested
Data updated today
About
Qwen text generation model. 758K downloads on HuggingFace.
Tested on 7 benchmarks with 37.4% average. Top scores: Aider — Code Editing (69.2%), IFEval (69.1%), BBH (HuggingFace) (44.2%).
Capabilities
coding
69.2
#17 globally
reasoning
7.0
#153 globally
math
32.5
#123 globally
knowledge
20.0
#198 globally
language
69.1
#71 globally
general
44.2
#14 globally
Benchmark Scores
Compare AllTested on 7 benchmarks · Ranked across 6 categories
Score Distribution (all 231 models)
0255075100
▲ You are here
codingCompare coding →
Aider — Code Editing
69.2—Code editing benchmark from the Aider project. Measures ability to apply targeted code changes while maintaining correctness and style.
reasoningCompare reasoning →
MUSR
7.0—HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.
mathCompare math →
MATH Level 5
32.5—HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.
vs Palmyra X5
vs o4 Mini Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Info
Research
Documentation
Community
Source Code
BenchGecko API
qwen-qwen25-coder-14b-instruct
Specifications
- Typetext-generation
- ContextN/A
- ReleasedNov 2024
- LicenseOpen Source
- StatusActive
Available On
AlibabaTBDLearn More
Share & Export
Frequently Asked Questions
Qwen2.5 Coder 14B Instruct is an open-source text-generation AI model by Alibaba, released in November 2024. It has an average benchmark score of 57.0.