Awesome Observability

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

Your window into all of your data

record and replay the web

Checkmate is an open-source, self-hosted tool designed to track and monitor server hardware, uptime, response times, and incidents in real-time with beautiful visualizations. Don't be shy, join here: https://discord.com/invite/NAb6H3UTjK :)

Open Source LLM Gateway 🦚

Connect Your Agents And Harnesses With Any Provider 🦚

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Agenta is a workspace where you and your team build agents and automations.

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.

Observe any stack, any service and any data, using any UI components you prefer, never missing any X factors and resolve them before they become real problems.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

Open source monitoring and visualization UI for the TICK stack

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

A tool to track SLA, SLO and Error budgets

OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

A Grafana panel for visualizing a Service Dependency Graph.

World's first fully integrated and fully Automated Kubernetes management and orchestration solution

the agent experience layer · observability + memory for AI coding agents (Claude Code + Codex) · local-first, typed, yours

Observability for AI coding assistants — cost tracking, efficiency scoring, and anti-pattern detection for Claude Code, Cursor, Copilot, and more. Local-first; New Relic optional.

Lightweight cost observability for every API call in your stack. Track LLM tokens, database ops, and external services from your terminal.

Lightweight self-hosted telemetry: errors, events, sessions, and a dashboard. Fastify API, Next.js UI, PostgreSQL, @telemetry-tracker/* SDKs.

Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.

SSL Certificate Expiry Monitor - Monitor SSL certificates and get alerts before they expire

Lightweight self hosted error tracking for indie devs and startup teams. Sentry SDK compatible. 2-container. Installation within 15s.

Weckr SDKs and Claude Skills: TypeScript, Python, MCP server, and an installable Claude Code plugin. AI cost and margin intelligence for SaaS, per user, per feature, per LLM call.

Local-first observability dashboard for AI agents. MCP-native. Look at every span your agents emit.

Unified observability gateway for AI agents — one MCP server for Prometheus, Loki, and any backend, with cross-signal anomaly detection and a built-in Web UI.

Global DNS Propagation Checker - Check DNS propagation across worldwide servers in real-time

Privacy-first endpoint health for Node, Go, and OpenTelemetry services.