huggingface-community-evals
skills/huggingface-community-evals · huggingface/skills · by Hugging Face
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.
Source · GitHub API and the SKILL.md frontmatter, read 2026-11-15 · stars are for the whole huggingface/skills repository
Install huggingface-community-evals
Ready-to-paste · from the repository README and the skill folder
# Copy this skill folder into your personal Claude Code skills git clone --depth 1 --filter=blob:none --sparse --branch main https://github.com/huggingface/skills.git /tmp/huggingface-community-evals-src git -C /tmp/huggingface-community-evals-src sparse-checkout set skills/huggingface-community-evals mkdir -p ~/.claude/skills cp -R /tmp/huggingface-community-evals-src/skills/huggingface-community-evals ~/.claude/skills/huggingface-community-evals
Skill repositories from other publishers in the open Agent Skills format (agentskills.io) · a folder with a SKILL.md plus optional scripts and resources, read by any client that supports the format.
More from Hugging Face
Same repository · huggingface/skills · latest commit first
Embeddable badge
Drop into your README · links to this skill page
[](https://benchgecko.ai/skills/huggingface-community-evals)
FAQ
Built from the GitHub data above
What is huggingface-community-evals?
huggingface-community-evals is a Agent Skills agent skill by Hugging Face, in the skills/huggingface-community-evals folder of the huggingface/skills repository (BenchGecko category: ML · Models). Its SKILL.md describes it as: Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.
Where does this data come from?
From GitHub, read 2026-11-15: the name and description from the SKILL.md frontmatter, 6 files from the repository tree, the last commit to the folder on 2026-03-23, and 11,351 stars for the whole huggingface/skills repository. BenchGecko does not rate skills.
How do I install huggingface-community-evals?
Copy the skills/huggingface-community-evals folder into ~/.claude/skills/ for Claude Code, use the command from the huggingface/skills README, or point any client that supports the Agent Skills format at the folder. Ready-to-paste snippets are above.
Is huggingface-community-evals official?
huggingface-community-evals is published in huggingface/skills, a repository owned by the Hugging Face organization on GitHub.
See also
Keep exploring the BenchGecko graph