Awesome Opensource Ai

Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.

✨ AI Coding, Vim Style

Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

an ambient intelligence library

A model-driven approach to building AI agents in just a few lines of code.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Chronos: Pretrained Models for Time Series Forecasting

Apache Maka (Incubating) is a high-performance agent workspace that keeps a complete record of everything it did.

🐢 Open-Source Evaluation & Testing library for LLM Agents

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

Robust recipes to align language models with human and AI preferences

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

A Next-Generation Training Engine Built for Ultra-Large MoE Models

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

A blazing fast inference solution for text embeddings models

A fast multimodal LLM for real-time voice

Achieve state of the art inference performance with modern accelerators on Kubernetes

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

LLM training code for Databricks foundation models

The Ruby-native AI framework. Chats, agents, tools, images, audio, and video through one consistent API, in plain Ruby or Rails.

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Optimizing inference proxy for LLMs

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

AdalFlow: The library to build & auto-optimize LLM applications.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

A system for agentic LLM-powered data processing and ETL

ADHD — a skill for coding agents. Tree-of-thought with pruning, built on the Claude & Codex Agent SDK. Fans out parallel divergent thoughts under different cognitive frames, scores, prunes traps, deepens the survivors. The no-brainer skill for creative and interdisciplinary work.

Harness LLMs with Multi-Agent Programming

An open-source model family for long-form speech, dialogue synthesis, voice design, sound effects, and real-time streaming TTS

OpenAgents - The collaboration OS for AI agents

The Harness of Harnesses: a trusted, persistent, self-evolving multi-agent ecosystem for all-domain collaboration.

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Build production-ready AI agents in both Python and Typescript.

II-Agent: a new open-source framework to build and deploy intelligent agents