Awesome Observability

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

AI Observability & Evaluation

An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.

Agenta is a workspace where you and your team build agents and automations.

AI observability platform for production LLM and agent systems.

Real-time network diagnostics in your terminal. One command, zero config, instant visibility.

Observe FastAPI app with three pillars of observability: Traces (Tempo), Metrics (Prometheus), Logs (Loki) on Grafana through OpenTelemetry.

Log Anomaly Detection - Machine learning to detect abnormal events logs

OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team.

the agent experience layer · observability + memory for AI coding agents (Claude Code + Codex) · local-first, typed, yours

Diff your AI agent's behavior between two runs. See exactly which tool calls, args, costs and outputs changed when you swap models or edit prompts.

Python SDK for accurate and verifiable agent tool use. Agents verify that answers came from the right source and were not changed. Downstream agents detect 100% of errors and retry to achieve a 50% jump in answer accuracy.

Generate the complete reliability stack from a service spec in 5 minutes. Dashboards, alerts, SLOs, PagerDuty - zero toil.

Open, reproducible benchmarks for crypto infrastructure: aggregators, bridges, blockchains, perps. Live data, public methodology.

Weckr SDKs and Claude Skills: TypeScript, Python, MCP server, and an installable Claude Code plugin. AI cost and margin intelligence for SaaS, per user, per feature, per LLM call.

Real-time Prometheus exporter for Duplicacy backups with live speed, progress, and completion metrics

Local-first observability dashboard for AI agents. MCP-native. Look at every span your agents emit.

Local replay debugger for Browser Use failures with screenshots, model I/O, failed-step timelines, and public-safe HTML exports.

Local-first DevTools for AI calls. See every LLM call your app makes: prompt, cost, tokens, latency, tool calls.

Deterministic pytest suite generator from Kibana API logs

Sentinel freshness checking for scheduled agent jobs: alert on missing success, not on errors