Hermes 3 70B Instruct vs Llama 3 8B Instruct
Lado a lado. Cada métrica. Cada benchmark.
| Tipo | Hermes 3 70B Instruct | Llama 3 8B Instruct |
|---|---|---|
| Provider |  nousresearch |  Meta |
| puntuación promedio | 38.5 | 30.8 |
| Precio de entrada | $0.30 | $0.03 |
| Precio de salida | $0.30 | $0.04 |
| Ventana de contexto | 131K tokens (~66 books) | 8K tokens (~4 books) |
| Publicado el | 2024-08-18 | 2024-04-18 |
| Código abierto | Open Source | Open Source |
Puntuaciones de benchmark
6 benchmarks · Hermes 3 70B Instruct: 6, Llama 3 8B Instruct: 0
| Benchmark | Categoría | Hermes 3 70B Instruct | Llama 3 8B Instruct |
|---|---|---|---|
| BBH (HuggingFace) | general | 53.8 | 18.4 |
| GPQA | knowledge | 14.9 | 2.1 |
| IFEval | language | 76.6 | 24.0 |
| MATH Level 5 | math | 21.0 | 3.9 |
| MMLU-PRO | knowledge | 41.4 | 17.8 |
| MUSR | reasoning | 23.4 | 19.9 |