Qwen2.5 72B Instruct vs GPT-4 Turbo
Côte à côte. Chaque métrique. Chaque benchmark.
| Type | Qwen2.5 72B Instruct | GPT-4 Turbo |
|---|---|---|
| Provider |  Alibaba Qwen |  OpenAI |
| score moyen | 53.2 | 51.0 |
| Prix d'entrée | $0.12 | $10.00 |
| Prix de sortie | $0.39 | $30.00 |
| Fenêtre de contexte | 33K tokens (~16 books) | 128K tokens (~64 books) |
| Sorti le | 2024-09-19 | 2024-04-09 |
| Code source ouvert | Open Source | Proprietary |
Scores de benchmark
9 benchmarks · Qwen2.5 72B Instruct: 6, GPT-4 Turbo: 3
| Benchmark | Catégorie | Qwen2.5 72B Instruct | GPT-4 Turbo |
|---|---|---|---|
| BBH | reasoning | 73.1 | 66.8 |
| CMMLU | knowledge | 85.7 | 71.0 |
| GPQA diamond | knowledge | 32.2 | 7.5 |
| HellaSwag | knowledge | 79.7 | 93.7 |
| MATH level 5 | math | 63.2 | 23.0 |
| MMLU | knowledge | 80.4 | 76.5 |
| OTIS Mock AIME 2024-2025 | math | 8.0 | 1.0 |
| TriviaQA | knowledge | 71.9 | 84.8 |
| Winogrande | knowledge | 64.6 | 75.0 |