o1 vs o1-preview
Lado a lado. Cada métrica. Cada benchmark.
| Tipo | o1 | o1-preview |
|---|---|---|
| Provider |  OpenAI | OpenAI |
| puntuación promedio | 56.4 | 41.5 |
| Precio de entrada | $15.00 | - |
| Precio de salida | $60.00 | - |
| Ventana de contexto | 200K tokens (~100 books) | - |
| Publicado el | 2024-12-17 | 2024-01-01 |
| Código abierto | Proprietary | Proprietary |
Puntuaciones de benchmark
7 benchmarks · o1: 5, o1-preview: 2
| Benchmark | Categoría | o1 | o1-preview |
|---|---|---|---|
| Aider — Code Editing | coding | 84.2 | 79.7 |
| ARC-AGI | reasoning | 30.7 | 18.0 |
| GPQA diamond | knowledge | 69.0 | 33.8 |
| MATH level 5 | math | 94.7 | 81.7 |
| OTIS Mock AIME 2024-2025 | math | 73.3 | 31.0 |
| SimpleBench | reasoning | 28.1 | 30.0 |
| WeirdML | coding | 43.8 | 47.6 |