Beta
Home/Models/Gpt Neo 125m
eleutherai logo

Gpt Neo 125m

by eleutherai · Released Mar 2022

Open Source
5.1
avg score
Rank #230
Compare
Better than 0% of all models
Context
N/A
Input $/1M
TBD
Output $/1M
TBD
Type
text-generation
License
Open Source
Benchmarks
6 tested
Data updated today
About

EleutherAI text generation model. 516K downloads on HuggingFace.

Tested on 6 benchmarks with 4.4% average. Top scores: IFEval (19.1%), BBH (HuggingFace) (3.4%), MUSR (2.6%).

Capabilities
reasoning
2.6
#174 globally
math
0.6
#215 globally
knowledge
0.4
#233 globally
language
19.1
#142 globally
general
3.4
#66 globally
Benchmark Scores
Compare All
Tested on 6 benchmarks · Ranked across 5 categories
Score Distribution (all 231 models)
0255075100
▲ You are here
MUSR

HuggingFace MuSR (Multi-Step Reasoning). Tests multi-hop reasoning requiring chaining multiple facts together.

2.6
MATH Level 5

HuggingFace evaluation of MATH Level 5 problems. Competition math requiring advanced reasoning and proof construction.

0.6
GPQA

HuggingFace evaluation of GPQA (Graduate-Level Google-Proof Q&A). PhD-level science questions that cannot be easily searched.

0.5
MMLU-PRO

HuggingFace MMLU-Pro. Harder version of MMLU with 10 answer choices instead of 4 and more challenging questions.

0.3
Excellent (85+) Good (70-85) Average (50-70) Below (<50)
Links
Documentation
Community
BenchGecko API
eleutherai-gpt-neo-125m
Specifications
  • Typetext-generation
  • ContextN/A
  • ReleasedMar 2022
  • LicenseOpen Source
  • StatusActive
Available On
eleutherai logoeleutheraiTBD
Share & Export
Tweet
Gpt Neo 125m is an open-source text-generation AI model by eleutherai, released in March 2022. It has an average benchmark score of 5.1.