Beta
Home/Comparar/Hermes 3 70B Instruct vs Llama 3 8B Instruct

Hermes 3 70B Instruct vs Llama 3 8B Instruct

Lado a lado. Cada métrica. Cada benchmark.

nousresearch
38.5
pontuação média
6/6
benchmarks
Meta
30.8
pontuação média
0/6
benchmarks
TipoHermes 3 70B InstructLlama 3 8B Instruct
Providernousresearch logonousresearchMeta logoMeta
pontuação média38.530.8
Preço de entrada$0.30$0.03
Preço de saída$0.30$0.04
Janela de contexto131K tokens (~66 books)8K tokens (~4 books)
Lançado em2024-08-182024-04-18
Código abertoOpen SourceOpen Source

6 benchmarks · Hermes 3 70B Instruct: 6, Llama 3 8B Instruct: 0

BenchmarkCategoriaHermes 3 70B InstructLlama 3 8B Instruct
BBH (HuggingFace)general53.818.4
GPQAknowledge14.92.1
IFEvallanguage76.624.0
MATH Level 5math21.03.9
MMLU-PROknowledge41.417.8
MUSRreasoning23.419.9