Awesome Opensource Ai

A programming framework for agentic AI

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

An open-source RAG-based tool for chatting with your documents.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

The LLM Evaluation Framework

Supercharge Your LLM Application Evaluations 🚀

AI Observability & Evaluation

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Adding guardrails to large language models.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Agenta is a workspace where you and your team build agents and automations.

Evaluation and Tracking for LLM Experiments and AI Agents

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

Weave is a toolkit for developing AI-powered applications, built by Weights & Biases.