huggingface-community-evals
huggingface-community-evals is an agent skill published by huggingface, listed under building agents. It lives in the huggingface/skills repository, which has 11,213 GitHub stars and is licensed under Apache-2.0; we last read it on 2026-09-16.
Runs evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware, suitable for backend selection, local GPU evaluations, and choosing between vLLM, Transformers, and accelerate.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads huggingface/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add huggingface/skills
Maintenance
Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.
huggingface-community-evals compared with similar skills
| Skill | Publisher | What it does | Repo stars | Last update |
|---|---|---|---|---|
| huggingface-community-evals (this page) | huggingface | Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend… | 11,213 | 2026-10-23 |
| claude-handoff | mattpocock | Hand the current conversation off to a fresh background agent that picks up the work immediately. | 303,549 | 2026-10-22 |
| context-engineering | addyosmani | Optimizes agent context setup. Use when starting a new session, when agent output quality degrades, when swit… | 110,611 | 2026-10-13 |
| using-agent-skills | addyosmani | Discovers and invokes agent skills. Use when starting a session, or when you need to decide which skill or wo… | 110,611 | 2026-10-13 |
| agent-platform-inference | Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemin… | 21,580 | 2026-10-25 | |
| agent-platform-skill-registry | Interact with the Gemini Enterprise Agent Platform Skill Registry to create and search for available skills.… | 21,580 | 2026-10-25 | |
| gemini-agents-api | Manages custom Agent resources on Gemini Enterprise Agent Platform. Use when the user wants to programmatical… | 21,580 | 2026-10-25 |
Skills from the same repository first, then others for this job by repository stars. Figures are from each repository when we last read it.
Common questions about huggingface-community-evals
- What does huggingface-community-evals do?
- Runs evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware, suitable for backend selection, local GPU evaluations, and choosing between vLLM, Transformers, and accelerate.
- How do I install huggingface-community-evals?
- Run npx skills add huggingface/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes huggingface-community-evals?
- huggingface.
- Is huggingface-community-evals maintained, and what licence does it use?
- Its repository has 11,213 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-23. The repository declares the Apache-2.0 licence.
More agent skills for building agents
- python-sdkby 101-skills
- widgets-uiby 101-skills
- context-engineeringby addyosmani
- using-agent-skillsby addyosmani
- anti-detect-browserby antibrow
- browser-mcp-agentby antibrow