Live1 models · 1 open source · avg 10.9
L
LMSYS
1
Total Models
tracked on BenchGecko
1
Open Source
100% of models
—
Cheapest Model
No pricing data
10.9
Avg Benchmark
across 1 scored models
Model Categories
LLM1
Open Source Ratio
100%
1 open source0 proprietary
All LMSYS Models1 total
| #▲ | Model | Avg | aider edit | aider poly? | ANLI? | APEX-Agents? | ARC AI2? | ARC-AGI? | ARC-AGI-2? | aa agentic | aa coding | aa quality | seal audio | seal audio | seal audio | Balrog? | BBH? | hf bbh | C-Eval | CadEval? | charxiv re | charxiv re | arena elo | arena elo | chess puzz? | CMMLU | CSQA2 | Cybench? | deepresear? | EnigmaEval | fiction li? | Fortress | frontierma? | frontierma? | GeoBench? | GPQA | GPQA diamond? | graphwalks | GSM8K? | GSO-Bench? | HellaSwag? | HELM · GPQA | helm ifeva | helm mmlu | helm omni | helm wildb | HLE? | hle tools | seal human | seal human | IFEval | jp jcommon | JHumanEval | JMMLU | JNLI | JSQuAD | LAMBADA? | lech mazur? | livebench | livebench | livebench | livebench | livebench | livebench | livebench | livebench | jp overall | MASK | MATH level 5? | MATH Level 5 | MCP Atlas | MMLU? | MMLU-PRO | MMMLU | mmmlu ar | mmmlu bn | mmmlu zh | mmmlu fr | mmmlu de | mmmlu hi | mmmlu id | mmmlu it | mmmlu ja | mmmlu ko | mmmlu pt | mmmlu es | mmmlu sw | mmmlu yo | seal multi | MultiNRC | MUSR | OpenBookQA? | oc aime202 | oc gpqa di | oc hle | oc ifeval | oc livecod | oc mmlu pr | OSWorld? | otis mock ? | PIQA? | posttrainb | seal pro r | seal pro r | seal prope | seal remot | ScienceQA? | SciPredict | SimpleBench? | simpleqa v? | seal swe a | seal swe a | swe bench | swe bench | swe bench | seal swe b | seal swe b | swe bench | swe bench ? | terminal b? | the agent ? | TriviaQA? | TutorBench | USAMO | VideoMME? | VISTA | seal visua | VPCT? | WeirdML? | Winogrande? | $/1M in | Context | Released |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | L Vicuna 7b V1.5 LMSYSOpen | 19.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 15.2 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 1.1 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 23.5 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 1.4 | - | - | 12.7 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 11.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | N/A | - | Jul 232y ago |
90+ Gold 80-89 70-79 60-69 <60Scores in % unless noted. Avg = unweighted mean across tested benchmarks.
About LMSYS
Quick answers · sourced from our data
How many models does LMSYS have?
BenchGecko tracks 1 model from LMSYS, of which 1 (100%) are open source. Every entry is updated daily from live provider feeds.
What is the best model from LMSYS?
Vicuna 7b V1.5 is currently the highest scoring LMSYS model we track, with an average benchmark score of 10.9. Scores are computed across every public benchmark we have data for.
How does LMSYS compare on benchmarks?
LMSYS models average 10.9 across the benchmarks we track · see the All Providers page for the full ranking by model count, open source ratio, and average score.
Is LMSYS open source?
Every LMSYS model we track is open source (1 of 1).