Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome observability page
GitHub stars and default-branch commits for adriannovegil/awesome-observability.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Write scalable load tests in plain Python 🚗💨
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
AI Observability & Evaluation
Easy & Flexible Alerting With ElasticSearch
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
An interactive NVIDIA-GPU process viewer and beyond, the one-stop solution for GPU process management.
AI observability platform for production LLM and agent systems.
FlameScope is a visualization tool for exploring different time ranges as Flame Graphs.
Load and performance benchmark tool
Automation-friendly framework for Continuous Testing by
Observe FastAPI app with three pillars of observability: Traces (Tempo), Metrics (Prometheus), Logs (Loki) on Grafana through OpenTelemetry.
ML powered analytics engine for outlier detection and root cause analysis.
Data collection framework for OpenTSDB
Streaming anomaly detection in Python: 16 online detectors (xStream, LODA, RS-Hash, Half-Space Trees, RRCF…) plus calibration and prequential evaluation for real-time data.
Plug-and-play homelab dashboard in one container — GPU, local-AI VRAM, Docker, systemd, host health. Built-in read-only MCP server so AI agents can explore it too.
Realistic synthetic events for testing, demos, and pipelines — streamed live or generated in bulk
Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
Open-source observability for your LLM application.
Free, read-only GPU waste scanner for Kubernetes inference clusters, by Paralleliq. Finds idle GPUs, oversized GPU tiers and wasted capacity in vLLM deployments.
a modular tool and framework for load generation that supports HTTP/2
Python SDK for accurate and verifiable agent tool use. Agents verify that answers came from the right source and were not changed. Downstream agents detect 100% of errors and retry to achieve a 50% jump in answer accuracy.
Real-time Prometheus exporter for Duplicacy backups with live speed, progress, and completion metrics
Local replay debugger for Browser Use failures with screenshots, model I/O, failed-step timelines, and public-safe HTML exports.
Chat-driven Prometheus visualization with one-click Grafana export. Self-hosted, single image, bring your own LLM.
Deterministic pytest suite generator from Kibana API logs
Grafana-native LLMOps dashboards for FinOps, agents, quality and AI governance, generated and visually verified.
Sentinel freshness checking for scheduled agent jobs: alert on missing success, not on errors
Integration bundle for Bering and Sheaft with Helm, OpenTelemetry overlays, dashboards, and CI/CD adapters
Send unhandled Python exceptions straight to a Telegram chat. No backend, no account, no database - just your own bot token.