Awesome Opensource Ai

Simple, unified interface to multiple Generative AI providers

Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase

Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms

Graph-Native Infrastructure for Context and Accountable AI Systems

structured outputs for llms

🚀 PR Agent: The Original Open-Source PR Reviewer. This project is not the Qodo free tier.

Build voice agents with open-source models

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

The Context Platform for your Data and AI Stack

No description.

The most powerful local music generation model that outperforms almost all commercial alternatives, supporting Mac, AMD, Intel, and CUDA devices.

Agent S: an open agentic framework that uses computers like a human

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

AI Observability & Evaluation

Low-code framework for building custom LLMs, neural networks, and other AI models

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Kimi Code CLI is your next CLI agent.

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

An Open-Source Asynchronous Coding Agent

Python bindings for llama.cpp

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

MiniCPM5: SOTA on-device LLMs, small yet powerful.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

Cybersecurity AI (CAI), the framework for AI Security

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

ModelScope: bring the notion of Model-as-a-Service to life.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Build effective agents using Model Context Protocol and simple workflow patterns

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

A vector search SQLite extension that runs anywhere!

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A Datacenter Scale Distributed Inference Serving Framework

Build autonomous AI agents in Python.

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

The Open Source Feature Store for AI/ML

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Yuxi = Cloud Agents + Knowledge RAG, Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.