Awesome Opensource Ai

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

🪨 why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Secure, fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

A reliable coding agent for complex software engineering tasks.

Fully autonomous AI Agents system capable of performing complex penetration testing tasks

Temporal service

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

Gas Town - multi-agent workspace manager

Workflow Engine for Kubernetes

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database​.

Google's open agentic orchestration runtime

The ultimate LLM/AI application development framework in Go.

Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.

Containers for machine learning

🤖 AI Gateway | AI Native API Gateway

Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

Manage multiple AI terminal agents like Claude Code, Codex, OpenCode, and Amp.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

lakeFS - Data version control for your data lake | Git for data

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Heterogeneous GPU Sharing on Kubernetes

Machine Learning Pipelines for Kubeflow

Kubernetes-native Job Queueing

Manages Unified Access to Generative AI Services built on Envoy Gateway

KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

Apache YuniKorn Core

The fastest developer workflow for every AI coding agent. Live status, quick prompts, worktrees, and diff review from one tmux TUI.

Terminal-native chat client for OpenClaw, Hermes, Ollama and OpenAI-compatible providers. A pure, beautiful terminal chat experience - connect to the gateway, pick an agent, and chat with streaming responses. No fuss, just chat.