Agent SkillsML · ModelsOfficial

huggingface-community-evals

skills/huggingface-community-evals · huggingface/skills · by Hugging Face

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Repo stars
11,351
huggingface/skills · 2026-11-15
Last commit
2026-03-23
to this skill folder
Files
6
3 scripts
License
Apache-2.0
repository license

Source · GitHub API and the SKILL.md frontmatter, read 2026-11-15 · stars are for the whole huggingface/skills repository

Ready-to-paste · from the repository README and the skill folder

# Copy this skill folder into your personal Claude Code skills
git clone --depth 1 --filter=blob:none --sparse --branch main https://github.com/huggingface/skills.git /tmp/huggingface-community-evals-src
git -C /tmp/huggingface-community-evals-src sparse-checkout set skills/huggingface-community-evals
mkdir -p ~/.claude/skills
cp -R /tmp/huggingface-community-evals-src/skills/huggingface-community-evals ~/.claude/skills/huggingface-community-evals
Claude Code reads skills from ~/.claude/skills/<name>/SKILL.md.Claude Code docs
Ecosystem · Agent Skills

Skill repositories from other publishers in the open Agent Skills format (agentskills.io) · a folder with a SKILL.md plus optional scripts and resources, read by any client that supports the format.

Files · 6
SKILL.mdexamples/.env.exampleexamples/USAGE_EXAMPLES.mdscripts/inspect_eval_uv.pyscripts/inspect_vllm_uv.pyscripts/lighteval_vllm_uv.py
Scripts · 3
scripts/inspect_eval_uv.pyscripts/inspect_vllm_uv.pyscripts/lighteval_vllm_uv.py

Same repository · huggingface/skills · latest commit first

Drop into your README · links to this skill page

huggingface-community-evals · listed on BenchGecko
[![huggingface-community-evals · listed on BenchGecko](https://benchgecko.ai/badge/skill/huggingface-community-evals.svg)](https://benchgecko.ai/skills/huggingface-community-evals)
The badge shows the skill ecosystem label · BenchGecko does not rate skills.

Built from the GitHub data above

What is huggingface-community-evals?

huggingface-community-evals is a Agent Skills agent skill by Hugging Face, in the skills/huggingface-community-evals folder of the huggingface/skills repository (BenchGecko category: ML · Models). Its SKILL.md describes it as: Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Where does this data come from?

From GitHub, read 2026-11-15: the name and description from the SKILL.md frontmatter, 6 files from the repository tree, the last commit to the folder on 2026-03-23, and 11,351 stars for the whole huggingface/skills repository. BenchGecko does not rate skills.

How do I install huggingface-community-evals?

Copy the skills/huggingface-community-evals folder into ~/.claude/skills/ for Claude Code, use the command from the huggingface/skills README, or point any client that supports the Agent Skills format at the folder. Ready-to-paste snippets are above.

Is huggingface-community-evals official?

huggingface-community-evals is published in huggingface/skills, a repository owned by the Hugging Face organization on GitHub.

Keep exploring the BenchGecko graph