Home/Models/Qwen2.5 Coder 0.5B Instruct
Alibaba logo

Qwen2.5 Coder 0.5B Instruct

by Alibaba · Released Nov 2024

Open Source
16.1
avg score
Rank #255
Compare
Better than 7% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text-generation
License
Open Source
Benchmarks
6 tested
Data updated today
About

Qwen text generation model. 479K downloads on HuggingFace.

Tested on 6 benchmarks with 20.8% average. Top scores: GSM8K (34.5%), HellaSwag (31.2%), MMLU (22.7%).

Capabilities
coding
14.3
#155 globally
math
34.5
#147 globally
knowledge
19.0
#238 globally
Benchmark Scores
Compare All
Tested on 6 benchmarks · Ranked across 3 categories
Score Distribution (all 274 models)
0255075100
▲ You are here
Aider — Code Editing

Code editing benchmark from the Aider project. Measures ability to apply targeted code changes while maintaining correctness and style.

14.3
GSM8K

Grade school math word problems. 8,500 problems testing multi-step arithmetic reasoning. A foundational math benchmark.

34.5
HellaSwag

Sentence completion requiring commonsense reasoning about physical and social situations. Tests real-world understanding.

31.2
MMLU

Massive Multitask Language Understanding. 57 subjects from STEM, humanities, and social sciences. The most widely-cited knowledge benchmark.

22.7
ARC AI2

AI2 Reasoning Challenge. Grade-school science questions requiring multi-step reasoning. Easy and Challenge sets test different difficulty levels.

12.5
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Documentation
Community
BenchGecko API
qwen-qwen25-coder-05b-instruct
Specifications
  • Typetext-generation
  • ContextN/A
  • ReleasedNov 2024
  • LicenseOpen Source
  • StatusActive
Available On
Alibaba logoAlibabaTBD
Share & Export
Tweet
Qwen2.5 Coder 0.5B Instruct is an open-source text-generation AI model by Alibaba, released in November 2024. It has an average benchmark score of 16.1.