Awesome Observability

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

A high-performance observability data pipeline.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

AI Observability & Evaluation

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Agenta is a workspace where you and your team build agents and automations.

Open-source observability for AI agents. Find where your agents fail, dispatch your coding agent to fix it, and verify the fix against real traces.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

A lightweight schema-on-read analytics in a single binary

World's first fully integrated and fully Automated Kubernetes management and orchestration solution

the agent experience layer · observability + memory for AI coding agents (Claude Code + Codex) · local-first, typed, yours

Agent and LLM API performance monitoring via network packet probe. Measures performance of OpenClaw, Claude, Codex, DeepAgents and more — deployed on the provider side, no SDK changes required.

Observability for AI coding assistants — cost tracking, efficiency scoring, and anti-pattern detection for Claude Code, Cursor, Copilot, and more. Local-first; New Relic optional.

Unified observability for logs, metrics and traces — low overhead instrumentation (Rust, Unreal Engine 5), OTLP ingestion, SQL analytics on DataFusion over Parquet, presentation through notebooks, Grafana and Python. Self-hosted.

Lightweight self-hosted telemetry: errors, events, sessions, and a dashboard. Fastify API, Next.js UI, PostgreSQL, @telemetry-tracker/* SDKs.

Lightweight self hosted error tracking for indie devs and startup teams. Sentry SDK compatible. 2-container. Installation within 15s.

Open, reproducible benchmarks for crypto infrastructure: aggregators, bridges, blockchains, perps. Live data, public methodology.

Local-first observability dashboard for AI agents. MCP-native. Look at every span your agents emit.

Privacy-first endpoint health for Node, Go, and OpenTelemetry services.