Live2 models · 2 open source · avg 4.0
D
DistilBERT
2
Total Models
tracked on BenchGecko
2
Open Source
100% of models
n/a
Cheapest Model
No pricing data
4.0
Avg Benchmark
across 1 scored models
Model Categories
LLM2
Open Source Ratio
100%
2 open source0 proprietary
All DistilBERT Models2 total
| #▲ | Model | Avg | ANLI? | APEX-Agents? | ARC AI2? | ARC-AGI? | ARC-AGI-2? | aider poly? | aider edit | aa critpt | aa gdpval | aa gpqa di | aa humanit | aa ifbench | aa long co | aa mmmu pr | aa scicode | aa termina | aa tau2 be | aa agentic? | aa coding ? | aa quality | seal audio | seal audio | seal audio | BBH? | hf bbh | Balrog? | C-Eval | CMMLU | CSQA2 | CadEval? | charxiv re? | charxiv re? | arena elo | arena elo | chess puzz? | Cl Bench | cl bench l | Cybench? | deepresear? | Deepswe | Dtbench | Ebr Bench | EnigmaEval | Exploitbench | fiction li? | Fortress | frontierma? | frontierma? | frontierma | frontierma | Frontiercode | Frontierswe | furniture | GPQA | GPQA diamond? | GSM8K? | GSO-Bench? | Gdpval | GeoBench? | graphwalks? | HELM · GPQA | helm ifeva | helm mmlu | helm omni | helm wildb | HLE? | hle tools | HellaSwag? | seal human | seal human | IFEval | jp jcommon | JHumanEval | JMMLU | JNLI | JSQuAD | LAMBADA? | jp overall | lech mazur? | livebench | livebench | livebench | livebench | livebench | livebench | livebench | livebench | Lmca | MASK | MATH Level 5 | MATH level 5? | MCP Atlas | MMLU? | MMLU-PRO | MMMLU | mmmlu ar | mmmlu bn | mmmlu zh | mmmlu fr | mmmlu de | mmmlu hi | mmmlu id | mmmlu it | mmmlu ja | mmmlu ko | mmmlu pt | mmmlu es | mmmlu sw | mmmlu yo | MUSR | metr time | Mirrorcode | seal multi | MultiNRC | mystery ga | OSWorld? | otis mock ? | OpenBookQA? | oc aime202 | oc gpqa di | oc hle | oc ifeval | oc livecod | oc mmlu pr | Osworld 2 0 | PIQA? | posttrainb | seal pro r | seal pro r | Proofbench | seal prope | remote lab | seal remot | seal swe a | seal swe a | seal swe b | seal swe b | swe bench ? | swe bench ? | swe bench | swe bench | swe bench | SciPredict | ScienceQA? | SimpleBench? | simpleqa v? | SpireClimb | surface ev | terminal b? | the agent ? | TriviaQA? | TutorBench | USAMO | VISTA | VPCT? | VideoMME? | seal visua | WeirdML? | WeirdML v3 | Winogrande? | $/1M in | Context | Released |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | D Distilgpt2 DistilBERTOpen | 8.3 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 2.8 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 1.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 6.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 0.6 | - | - | - | 2.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 11.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | n/a | - | Mar 224y ago |
90+ Gold 80-89 70-79 60-69 <60Scores in % unless noted. Avg = unweighted mean across tested benchmarks.
About DistilBERT
Quick answers · sourced from our data
How many models does DistilBERT have?
BenchGecko tracks 2 models from DistilBERT, of which 2 (100%) are open source. Every entry is updated daily from live provider feeds.
What is the best model from DistilBERT?
Distilgpt2 is currently the highest scoring DistilBERT model we track, with an average benchmark score of 4.0. Scores are computed across every public benchmark we have data for.
How does DistilBERT compare on benchmarks?
DistilBERT models average 4.0 across the benchmarks we track · see the All Providers page for the full ranking by model count, open source ratio, and average score.
Is DistilBERT open source?
Every DistilBERT model we track is open source (2 of 2).