m365-agent-evaluator
m365-agent-evaluator is an agent skill published by microsoft, listed under building agents. It lives in the microsoft/skills repository, which has 3,148 GitHub stars and is licensed under MIT; we last read it on 2026-09-16.
This tool allows users to create, run, and analyze evaluation suites for Microsoft 365 Copilot declarative agents using the public @microsoft/m365-copilot-eval CLI. No specific credentials are required.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads microsoft/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add microsoft/skills
Maintenance
Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot declarative agents with the public @microsoft/m365-copilot-eval CLI. Trigger on intents such as "evaluate my agent", "test my agent", "run my evals", "create eval prompts", "add multi-turn tests", "tune evaluator thresholds", "why is my agent failing", or "set up eval environment variables".
m365-agent-evaluator compared with similar skills
| Skill | Publisher | What it does | Repo stars | Last update |
|---|---|---|---|---|
| m365-agent-evaluator (this page) | microsoft | Use this skill when a user wants to create, run, or analyze evaluation suites for Microsoft 365 Copilot decla… | 3,148 | 2026-10-25 |
| agent-framework-azure-ai-py(same repository) | microsoft | Build Azure AI Foundry agents using the Microsoft Agent Framework Python SDK (agent-framework-azure-ai). Use… | 3,148 | 2026-10-25 |
| azure-ai-agents-persistent-java(same repository) | microsoft | Azure AI Agents Persistent SDK for Java. Low-level SDK for creating and managing AI agents with threads, mess… | 3,148 | 2026-10-25 |
| azure-ai-projects-dotnet(same repository) | microsoft | Azure AI Projects SDK for .NET. High-level client for Azure AI Foundry projects including agents, connections… | 3,148 | 2026-10-25 |
| azure-ai-projects-py(same repository) | microsoft | Build AI applications using the Azure AI Projects Python SDK (azure-ai-projects). Use when working with Found… | 3,148 | 2026-10-25 |
| azure-resource-manager-durabletask-dotnet(same repository) | microsoft | Azure Resource Manager SDK for Durable Task Scheduler in .NET. Use for MANAGEMENT PLANE operations: creating/… | 3,148 | 2026-10-25 |
| m365-agents-py(same repository) | microsoft | Microsoft 365 Agents SDK for Python. Build multichannel agents for Teams/M365/Copilot Studio with aiohttp hos… | 3,148 | 2026-10-25 |
Skills from the same repository first, then others for this job by repository stars. Figures are from each repository when we last read it.
Common questions about m365-agent-evaluator
- What does m365-agent-evaluator do?
- This tool allows users to create, run, and analyze evaluation suites for Microsoft 365 Copilot declarative agents using the public @microsoft/m365-copilot-eval CLI. No specific credentials are required.
- How do I install m365-agent-evaluator?
- Run npx skills add microsoft/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes m365-agent-evaluator?
- microsoft.
- Is m365-agent-evaluator maintained, and what licence does it use?
- Its repository has 3,148 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-25. The repository declares the MIT licence.
More agent skills for building agents
- python-sdkby 101-skills
- widgets-uiby 101-skills
- context-engineeringby addyosmani
- using-agent-skillsby addyosmani
- anti-detect-browserby antibrow
- browser-mcp-agentby antibrow