omni-ai-eval
omni-ai-eval is an agent skill published by exploreomni, listed under analytics & experiments. It lives in the exploreomni/omni-agent-skills repository, which has 45 GitHub stars and is licensed under NOASSERTION; we last read it on 2026-09-25.
Evaluates Omni AI accuracy using Omni's built-in eval system by defining a prompt set and running a judged eval against a model or branch. Credentials required: none.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads exploreomni/omni-agent-skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add exploreomni/omni-agent-skills
Maintenance
Evaluate Omni AI accuracy using Omni's built-in eval system — define a prompt set, run a judged eval against a model (or branch), and read the accuracy-judge verdicts. Use this skill whenever someone wants to evaluate Omni AI, benchmark Blobby, run regression tests, compare AI output across branches or model-context changes, measure AI quality, run A/B tests on model changes, assess the impact of an ai_context or modeling change, or any variant of "run evals", "test Blobby", "benchmark query generation", "compare AI results", "regression test", "how accurate is the AI", or "measure the impact of my changes".
omni-ai-eval compared with similar skills
| Skill | Publisher | What it does | Repo stars | Last update |
|---|---|---|---|---|
| omni-ai-eval (this page) | exploreomni | Evaluate Omni AI accuracy using Omni's built-in eval system — define a prompt set, run a judged eval against… | 45 | 2026-10-26 |
| incremental-implementation | addyosmani | Delivers changes incrementally in thin, verifiable slices. Use when implementing any feature or change that t… | 110,611 | 2026-10-13 |
| golang-observability | samber | Golang everyday observability — the always-on signals in production. Covers structured logging with slog, Pro… | 3,672 | 2026-10-23 |
| azure-appconfiguration-java | microsoft | Azure App Configuration SDK for Java. Centralized application configuration management with key-value setting… | 3,148 | 2026-10-25 |
| azure-appconfiguration-ts | microsoft | Build applications using Azure App Configuration SDK for JavaScript (@azure/app-configuration). Use when work… | 3,148 | 2026-10-25 |
| youtube-thumbnail-design | 101-skills | YouTube thumbnail design with specific dimensions, contrast rules, and mobile preview optimization. Covers sa… | 781 | 2026-10-15 |
| firebase-remote-config-basics | firebase | Manages Firebase Remote Config templates, feature flags, loading strategies, and SDKs (Android, iOS). Use whe… | 488 | 2026-10-20 |
Skills from the same repository first, then others for this job by repository stars. Figures are from each repository when we last read it.
Common questions about omni-ai-eval
- What does omni-ai-eval do?
- Evaluates Omni AI accuracy using Omni's built-in eval system by defining a prompt set and running a judged eval against a model or branch. Credentials required: none.
- How do I install omni-ai-eval?
- Run npx skills add exploreomni/omni-agent-skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes omni-ai-eval?
- exploreomni.
- Is omni-ai-eval maintained, and what licence does it use?
- Its repository has 45 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-26. The repository declares the NOASSERTION licence.
More agent skills for analytics & experiments
- youtube-thumbnail-designby 101-skills
- incremental-implementationby addyosmani
- agent-observability-replay-traceby datadog-labs
- dd-browser-sdkby datadog-labs
- dd-instrument-rumby datadog-labs
- firebase-remote-config-basicsby firebase