Awesome Opensource Ai

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Optimize prompts, code, and more with AI-powered Reflective Optimization

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

Upserts, Deletes And Incremental Processing on Big Data.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Democratizing Reinforcement Learning for LLMs

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Framework for evaluating and improving agents

Ecommerce Search and Discovery - marqo.ai

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

Agenta is a workspace where you and your team build agents and automations.

Align Anything: Training All-modality Model with Feedback

Reliable Multi-Agent Orchestration Framework

A light-weight, flexible, and expressive statistical data testing library

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

A nearly-live implementation of OpenAI's Whisper.

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

AdalFlow: The library to build & auto-optimize LLM applications.

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

A system for agentic LLM-powered data processing and ETL

OpenAgents - The collaboration OS for AI agents

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

Generative models for conditional audio generation

Open-source security automation platform for teams and AI agents

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Open-source multimodal retrieval engine (Morphik Core)

Evaluation and Tracking for LLM Experiments and AI Agents