diagnosing-experiment-results
diagnosing-experiment-results is the official agent skill of PostHog published by posthog, listed under analytics & experiments. It lives in the PostHog/skills repository, which has 75 GitHub stars and is licensed under MIT; we last read it on 2026-09-25.
Diagnoses bias, anomalies, and strange results in PostHog experiments, covering various scenarios such as 0-exposure experiments, sample ratio mismatch, identity fragmentation, and uneven-split exclusion bias. Requires no specific credentials.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads PostHog/skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add PostHog/skills
What it connects to
Unverified means a mention in the skill’s own description, not a citation. A wrong claim here costs nothing to correct and nothing to trust yet.
Maintenance
Diagnoses bias, anomalies, and strange results on a PostHog experiment. Covers 0-exposure experiments, sample ratio mismatch, identity fragmentation, multi-variant exposure, uneven-split exclusion bias, significance traps (peeking, A/A, Bayesian vs Frequentist), PostHog-vs-SQL discrepancies, surprises after mid-run edits, and qualitative follow-up via a variant-split survey.\nTRIGGER when: user asks 'is my experiment biased?' or 'why 0 exposures?', references the bias banner, says a variant looks strange / wrong / off, sees significance flipping or A/A significance, finds PostHog numbers disagreeing with their SQL, reports surprises after mid-run edits, or wants qualitative feedback or a survey for an experiment.\nDO NOT TRIGGER when: creating an experiment (use creating-experiments), only configuring rollout (use configuring-experiment-rollout) or metrics (use configuring-experiment-analytics), or only asking lifecycle questions (use managing-experiment-lifecycle).
diagnosing-experiment-results compared with similar skills
| Skill | Publisher | What it does | Repo stars | Last update |
|---|---|---|---|---|
| diagnosing-experiment-results (this page) | posthog | Diagnoses bias, anomalies, and strange results on a PostHog experiment. Covers 0-exposure experiments, sample… | 75 | 2026-10-25 |
| account-handover(same repository) | posthog | Draft structured handover notes for transitioning a PostHog account from one TAM or CSM to another. Use this… | 75 | 2026-10-25 |
| adding-warehouse-person-properties(same repository) | posthog | Sync columns from a synced data warehouse table onto PostHog person or group properties, so warehouse data be… | 75 | 2026-10-25 |
| analyzing-experiment-session-replays(same repository) | posthog | Analyze session replay patterns across experiment variants to understand user behavior differences. Use when… | 75 | 2026-10-25 |
| analyzing-task-runs(same repository) | posthog | Split a completed PostHog task run into activity records — what the agent tried, whether it worked, what bloc… | 75 | 2026-10-25 |
| assessing-heatmaps(same repository) | posthog | Assesses what a page's heatmap is telling you and recommends concrete changes. Pulls click / rageclick / scro… | 75 | 2026-10-25 |
| auditing-endpoints(same repository) | posthog | Audit every endpoint in a PostHog project for staleness, failed materialisations, and unused materialised ver… | 75 | 2026-10-25 |
Skills from the same repository first, then others for this job by repository stars. Figures are from each repository when we last read it.
Common questions about diagnosing-experiment-results
- What does diagnosing-experiment-results do?
- Diagnoses bias, anomalies, and strange results in PostHog experiments, covering various scenarios such as 0-exposure experiments, sample ratio mismatch, identity fragmentation, and uneven-split exclusion bias. Requires no specific credentials.
- How do I install diagnosing-experiment-results?
- Run npx skills add PostHog/skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes diagnosing-experiment-results?
- posthog. It is named as the official skill of PostHog.
- Is diagnosing-experiment-results maintained, and what licence does it use?
- Its repository has 75 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-25. The repository declares the MIT licence.
More agent skills for analytics & experiments
- youtube-thumbnail-designby 101-skills
- incremental-implementationby addyosmani
- agent-observability-replay-traceby datadog-labs
- dd-browser-sdkby datadog-labs
- dd-instrument-rumby datadog-labs
- omni-ai-evalby exploreomni