Awesome Observability

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

SigNoz is an open-source, OpenTelemetry-native observability platform for your team and their AI agents. Get logs, metrics, and traces in one tool with features like APM, distributed tracing, log management, infra monitoring, etc. Combined with SigNoz MCP and a native AI teammate (in SigNoz Cloud) it helps you build more resilient apps.

Write scalable load tests in plain Python 🚗💨

A high-performance observability data pipeline.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

record and replay the web

Zipkin is a distributed tracing system

AI Observability & Evaluation

Checkmate is an open-source, self-hosted tool designed to track and monitor server hardware, uptime, response times, and incidents in real-time with beautiful visualizations. Don't be shy, join here: https://discord.com/invite/NAb6H3UTjK :)

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Prometheus Alertmanager

Open Source LLM Gateway 🦚

Connect Your Agents And Harnesses With Any Provider 🦚

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

M3 monorepo - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform

Agenta is a workspace where you and your team build agents and automations.

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.

Observe any stack, any service and any data, using any UI components you prefer, never missing any X factors and resolve them before they become real problems.

Distributed tracing without code changes. 🚀 Instantly monitor any application using OpenTelemetry and eBPF

OpenTelemetry Collector distribution with programmable pipelines

Vector is an on-host performance monitoring framework which exposes hand picked high resolution metrics to every engineer’s browser.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

Simple gRPC benchmarking and load testing tool

FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

Open source monitoring and visualization UI for the TICK stack

Simple Kubernetes real-time dashboard and management.

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

Dev Tools for the Serverless World - Issues, PRs and ⭐️welcome!

ML powered analytics engine for outlier detection and root cause analysis.

A tool to track SLA, SLO and Error budgets

A lightweight schema-on-read analytics in a single binary

inspectIT Ocelot - Java agent for collecting application performance, tracing and behavior data

A Grafana panel for visualizing a Service Dependency Graph.

World's first fully integrated and fully Automated Kubernetes management and orchestration solution

the agent experience layer · observability + memory for AI coding agents (Claude Code + Codex) · local-first, typed, yours

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude, Codex, DeepAgents and more — deployed on the provider side, no SDK changes required.

Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk

🇺🇦🇵🇱 A static analysis tool for OpenTelemetry Collector configurations. Built on OPA/Rego, it validates your pipelines, receivers, processors, and exporters against customizable policy rules – catching misconfigurations before they reach production

Observability for AI coding assistants — cost tracking, efficiency scoring, and anti-pattern detection for Claude Code, Cursor, Copilot, and more. Local-first; New Relic optional.

Unified observability for logs, metrics and traces — low overhead instrumentation (Rust, Unreal Engine 5), OTLP ingestion, SQL analytics on DataFusion over Parquet, presentation through notebooks, Grafana and Python. Self-hosted.

Lightweight self-hosted telemetry: errors, events, sessions, and a dashboard. Fastify API, Next.js UI, PostgreSQL, @telemetry-tracker/* SDKs.

Lightweight self hosted error tracking for indie devs and startup teams. Sentry SDK compatible. 2-container. Installation within 15s.

Open, reproducible benchmarks for crypto infrastructure: aggregators, bridges, blockchains, perps. Live data, public methodology.

Local-first observability dashboard for AI agents. MCP-native. Look at every span your agents emit.

Local-first DevTools for AI calls. See every LLM call your app makes: prompt, cost, tokens, latency, tool calls.

Chat-driven Prometheus visualization with one-click Grafana export. Self-hosted, single image, bring your own LLM.

Privacy-first endpoint health for Node, Go, and OpenTelemetry services.