Tracing and monitoring
What a system did in production: spans, latency, token counts, errors and the trace of a single request. Whether the answer was any good is evaluation and benchmarking — eight products do both and are filed in both.
30 in this category
NARROW BY WHAT THIS CATEGORY ASKS
LICENCE · 7 NOT READ
OPEN SOURCE · 13 NOT READ
OPENTELEMETRY · 14 NOT READ
PRODUCTUSED BYSTARSDOWNLOADS 30D
PostHog:hedgehog: PostHog is the leading platform for building self-driving products. Our developer tools – AI observability, analytics, session replay, flags, experiments, error tracking, logs, and more – c39,756
langfuseLangfuse Python SDK - LLM observability/tracing, datasets, experiments, LLM-as-a-judge evaluation, and prompt management1634,9087,219,046
opikComet tool for logging and evaluating LLM traces122,182
ragaai-catalystPython SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal16,164
RagasEvaluation framework for RAG and LLM applications215,698
Arize PhoenixAI Observability and Evaluation411,4101,470,040
bifrostFastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.8,214
evidentlyEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.7,932
Traceloop OpenLLMetryTraceloop Software Development Kit (SDK) for Python17,4281,856,192
HeliconeA Python wrapper for the OpenAI API that logs all requests to Helicone.6,14212,777
latitude-llmOpen-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.4,633
TruLensLibrary to systematically track and evaluate LLM based applications.3,54523,587
langwatchThe platform for LLM evaluations and AI agent testing3,531
pezzo🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.3,272
lmnrLaminar - open-source observability platform purpose-built for AI agents. YC S24.3,248
openlitOpen-source observability & evaluation platform for AI agents and coding agents. Trace LLMs, tools, prompts, costs & agent workflows with OpenTelemetry.2,756Ttracely-aiTrace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.1,404
Weights & Biases WeaveA toolkit for building composable interactive data driven applications.21,127
judgevalThe Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.1,060
TraceRootTraceRoot - open-source observability and self-improving layer for AI agents. YC S25764
databuffDataBuff is an AI-native APM built on Opentelemetry，with multi-agent troubleshooting out of the box.670
AdalineThe only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.606
clawmetrySee your agent think. Zero-config observability & governance for 30 AI agent runtimes: Claude Code, OpenAI Codex, Hermes, OpenClaw & 26 more. Live token costs, sessions, tool calls, crons.414
agent-prismReact components for visualizing traces from AI agents390AaegisRuntime policy enforcement for AI agents. Cryptographic audit trail, human-in-the-loop approvals, kill switch. Zero code changes.340
BraintrustSDK for integrating Braintrust3275,607,117
Fiddler AIPython client for Fiddler Platform24,780
GalileoAI observability and evaluation for GenAI applications
HoneyHiveHoneyHive Python SDK - LLM Observability and Evaluation Platform12,994
LangSmithClient library to connect to the LangSmith Observability and Evaluation Platform.1524,619,866SORTED BY ONE STATED COLUMN · USED BY = LISTED PRODUCTS DEPENDING ON IT, IN THIS DIRECTORY — NOT A POPULARITY FIGURE · NO OVERALL SCORE AND NO RANK COLUMN, BECAUSE BLENDING ADOPTION, STARS AND DOWNLOADS NEEDS WEIGHTS, AND WEIGHTS ARE AN OPINION PRESENTED AS ARITHMETIC
Cite this page
The count and its date sit inside the citation, because “Tracing and monitoring” without a date is a claim that quietly goes wrong as the category fills.
infratoapp, “Tracing and monitoring — Observability / Evals”, read 28 October 2026. 30 listed products. https://www.infratoapp.com/layers/observability/tracing
No overall score, and no rank column
Blending adoption, stars and downloads needs weights, and weights are an opinion presented as arithmetic — so this table sorts by one stated column at a time and shows which. This view holds no billing column and joins no billing table: a sponsor cannot appear higher, and the signals meter is a row’s own confidence, never a score you can sort on.
Frequently asked
What is in the Tracing and monitoring category?
30 products in the Observability / Evals layer of the AI stack. What a system did in production: spans, latency, token counts, errors and the trace of a single request. Whether the answer was any good is evaluation and benchmarking — eight products do both and are filed in both. Listed members include PostHog, langfuse and opik. Every fact on each listing carries the page it was read from and the date it was read.
How are Tracing and monitoring compared here?
By the 7 attributes this category declares, asked of every member and answered only where a source states it. A product with no answer on record shows a gap rather than a guess, and no blended score is published — weights would be an opinion presented as arithmetic.
PostHog or langfuse?
Both are listed under Tracing and monitoring. We publish no verdict between them — we hold no benchmark that would support one. What we do hold is the same attribute sheet for each, side by side with the source behind every value, at /compare/langfuse-vs-posthog.
What does a blank mean on a tracing and monitoring row?
That nobody has told us, not that the answer is no. A hollow ring is "no answer on record", which is a different state from a recorded no — and the two look different on purpose. A listing with a blank has not failed the question; it has not been read for it.
How often are tracing and monitoring figures re-read?
Every value carries the date it was read and a link to the page it came from. Prices move fastest and are re-read most often; an attribute read weeks ago says so rather than presenting itself as current. Anything past 21 days is hidden rather than shown stale.
Is this every tracing and monitoring there is?
No. This is 30 we have read and can cite. A directory that claimed completeness would be making a promise it cannot keep, so the page states its own count instead and says when a category is too thin to shortlist from.
Can a vendor pay to rank higher here?
No. Nothing on this page can be bought: a sponsor cannot enter a table, reorder a row or change a mark, and there is no ranked position for sale. How the site is paid for, and the line each source of money does not cross, is set out under money and independence at /our-data#sec5.