Qwen2-72B vs Qwen2.5 72B Instruct
Côte à côte. Chaque métrique. Chaque benchmark.
| Type | Qwen2-72B | Qwen2.5 72B Instruct |
|---|---|---|
| Provider | ||
| score moyen | 41.3 | 53.2 |
| Prix d'entrée | - | $0.12 |
| Prix de sortie | - | $0.39 |
| Fenêtre de contexte | - | 33K tokens (~16 books) |
| Sorti le | 2024-01-01 | 2024-09-19 |
| Code source ouvert | Open Source | Open Source |
Scores de benchmark
12 benchmarks · Qwen2-72B: 4, Qwen2.5 72B Instruct: 8
| Benchmark | Catégorie | Qwen2-72B | Qwen2.5 72B Instruct |
|---|---|---|---|
| Aider — Code Editing | coding | 55.6 | 65.4 |
| BBH (HuggingFace) | general | 51.9 | 61.9 |
| CMMLU | knowledge | 89.7 | 85.7 |
| GPQA | knowledge | 19.2 | 16.7 |
| GPQA diamond | knowledge | 21.0 | 32.2 |
| IFEval | language | 38.2 | 86.4 |
| MATH level 5 | math | 39.1 | 63.2 |
| MATH Level 5 | math | 31.1 | 59.8 |
| MMLU | knowledge | 76.5 | 80.4 |
| MMLU-PRO | knowledge | 52.6 | 51.4 |
| MUSR | reasoning | 19.7 | 11.7 |
| The Agent Company | agentic | 1.1 | 5.7 |