Awesome Opensource Ai

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

21 Lessons, Get Started Building with Generative AI

A Simple and Universal Swarm Intelligence Engine, Predicting Anything. 简洁通用的群体智能引擎，预测万物

🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Learn how to develop, deploy and iterate on production-grade ML applications.

Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows, automation, and chat apps

In-depth tutorials on LLMs, RAGs and real-world AI agent applications.

A modular graph-based Retrieval-Augmented Generation (RAG) system

Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities.

Self-hosted AI coding assistant

Build Real-Time Knowledge Graphs for AI Agents

An autonomous agent that conducts deep research on any data using any LLM providers

🚀 The fast, Pythonic way to build MCP servers and clients.

An open-source RAG-based tool for chatting with your documents.

An open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.

Structured Outputs

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Access large language models from the command-line

AI Observability & Evaluation

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

An Open-Source Asynchronous Coding Agent

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

Build effective agents using Model Context Protocol and simple workflow patterns

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Build autonomous AI agents in Python.

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Yuxi = Cloud Agents + Knowledge RAG, Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Efficient Triton Kernels for LLM Training

Agent framework for the JVM. Pronounced Em-BAY-bel /ɛmˈbeɪbəl/

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

Evaluation and Tracking for LLM Experiments and AI Agents

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

An open-source visual programming environment for battle-testing prompts to LLMs.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI.

ContextGem: Effortless LLM extraction from documents

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

KaibanJS is a JavaScript-native framework for building and managing multi-agent systems with a Kanban-inspired approach.