Qwen2.5 Coder 32B Instruct
开源来自 Alibaba Qwen · 发布于 2024-11-11
53.1
平均分
$0.66/1M
输入价格
$1.00/1M
输出价格
33K tokens (~16 books)
上下文窗口
text
类型
Tested on 14 benchmarks with 53.1% average. Top scores: Chatbot Arena Elo — Overall (1269.9%), GSM8K (91.1%), HellaSwag (77.3%).
基准测试分数
| 基准测试 | 类别 | 分数 | Bar |
|---|---|---|---|
| Chatbot Arena Elo — Overall | arena | 1269.9 | |
| GSM8K | math | 91.1 | |
| HellaSwag | knowledge | 77.3 | |
| IFEval | language | 72.7 | |
| MMLU | knowledge | 72.1 | |
| Aider — Code Editing | coding | 71.4 | |
| Winogrande | knowledge | 61.6 | |
| ARC AI2 | knowledge | 60.7 | |
| BBH (HuggingFace) | general | 52.3 | |
| MATH Level 5 | math | 49.5 | |
| MMLU-PRO | knowledge | 37.9 | |
| Aider polyglot | coding | 16.4 | |
| MUSR | reasoning | 13.7 | |
| GPQA | knowledge | 13.2 |
相似模型
DeepSeek
53.2
DeepSeek
53.0
OpenAI
53.2
Alibaba Qwen
53.2