agent-observability-replay-trace
agent-observability-replay-trace is an agent skill published by datadog-labs, listed under analytics & experiments. It lives in the datadog-labs/agent-skills repository, which has 178 GitHub stars and is licensed under MIT; we last read it on 2026-10-23.
This tool allows developers to re-run a specific Agent Observability or LLM Obs trace locally, compare the new output with the old, and iterate until the desired result is achieved. It requires a trace ID from the Agent Observability UI and edits to the local code. No local server or browser is needed. It works with ddtrace/LLM Obs traces (Python first-class) with JSON-serializable input.
Install
skills is a generic installer for any repository of Claude agent skills -- it reads datadog-labs/agent-skills’s own structure rather than assuming one, the same way this page reads the skill’s own SKILL.md rather than assuming a format.
npx skills add datadog-labs/agent-skills
Maintenance
Use when a developer wants to iterate on ONE specific Agent Observability / LLM Obs trace whose output they didn't like — re-running that trace against their LOCAL code, seeing a concise diff of the old vs new output, and looping (change code → replay → diff) until satisfied. Invoked as /agent-observability-replay-trace <trace-id> [changes to test]. Signals: "replay this trace"; "iterate on a trace"; "this trace's output is wrong, fix it and re-run"; "re-run trace <id> with <change>"; pasting a trace id from the Agent Observability UI with a description of what to fix. It fetches the trace via the datadog-llmo MCP or the pup CLI, edits code, re-runs the app to emit a NEW trace, and diffs the two — no local server, no browser. For agents traced with ddtrace / LLM Obs (Python first-class), with JSON-serializable entry input. Do NOT use for: scored Experiments or the browser "Replay" button (that's agent-observability-replay-experiment), building an experiment from a dataset/CSV, writing evaluators, root-causing failed traces, or RUM/HTTP session replay.
agent-observability-replay-trace compared with similar skills
| Skill | Publisher | What it does | Repo stars | Last update |
|---|---|---|---|---|
| agent-observability-replay-trace (this page) | datadog-labs | Use when a developer wants to iterate on ONE specific Agent Observability / LLM Obs trace whose output they d… | 178 | 2026-10-22 |
| dd-browser-sdk(same repository) | datadog-labs | Datadog Browser SDK — RUM, Logs, Session Replay, profiling, product analytics, and error tracking setup, conf… | 178 | 2026-10-22 |
| dd-instrument-rum(same repository) | datadog-labs | Instrument browser-based web applications with Datadog Browser RUM. Detect the application framework, router,… | 178 | 2026-10-22 |
| incremental-implementation | addyosmani | Delivers changes incrementally in thin, verifiable slices. Use when implementing any feature or change that t… | 110,611 | 2026-10-13 |
| golang-observability | samber | Golang everyday observability — the always-on signals in production. Covers structured logging with slog, Pro… | 3,672 | 2026-10-23 |
| azure-appconfiguration-java | microsoft | Azure App Configuration SDK for Java. Centralized application configuration management with key-value setting… | 3,148 | 2026-10-25 |
| azure-appconfiguration-ts | microsoft | Build applications using Azure App Configuration SDK for JavaScript (@azure/app-configuration). Use when work… | 3,148 | 2026-10-25 |
Skills from the same repository first, then others for this job by repository stars. Figures are from each repository when we last read it.
Common questions about agent-observability-replay-trace
- What does agent-observability-replay-trace do?
- This tool allows developers to re-run a specific Agent Observability or LLM Obs trace locally, compare the new output with the old, and iterate until the desired result is achieved. It requires a trace ID from the Agent Observability UI and edits to the local code. No local server or browser is needed. It works with ddtrace/LLM Obs traces (Python first-class) with JSON-serializable input.
- How do I install agent-observability-replay-trace?
- Run npx skills add datadog-labs/agent-skills. The skills installer reads the repository’s own structure, so it works for any repository of agent skills.
- Who publishes agent-observability-replay-trace?
- datadog-labs.
- Is agent-observability-replay-trace maintained, and what licence does it use?
- Its repository has 178 GitHub stars and its state in our directory is listed. Its last commit we recorded was on 2026-10-22. The repository declares the MIT licence.
More agent skills for analytics & experiments
- youtube-thumbnail-designby 101-skills
- incremental-implementationby addyosmani
- dd-browser-sdkby datadog-labs
- dd-instrument-rumby datadog-labs
- omni-ai-evalby exploreomni
- firebase-remote-config-basicsby firebase