Awesome Opensource Ai

Lightweight coding agent that runs in your terminal

A high-throughput and memory-efficient inference and serving engine for LLMs

Code at the speed of thought – Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter.

Open Data Platform for analysts, quants and AI agents.

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.

Hundreds of models & providers. One command to find what runs on your hardware.

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

SGLang is a high-performance serving framework for large language models and multimodal models.

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

Self-hosted AI coding assistant

A hive mind communication platform

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

Search infrastructure for AI

A high-performance observability data pipeline.

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Cloud-native OSS search engine for observability

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

Containers for machine learning

⚙️🦀 Build modular and scalable LLM Applications in Rust

OpenShell is the safe, private runtime for autonomous AI agents.

🧱 Easy fast local-first microVM runtime and library

A Datacenter Scale Distributed Inference Serving Framework

Fast, flexible LLM inference

XERJ is the new way for AI to search data. Its autoindex capability activates agents to know your data without the token waste of grep and sed. One command indexes code, docs, logs and PDFs for search, RAG, security audits and agent memory, using 40x fewer tokens than grep. Elasticsearch compatible, so existing clients just work.

HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

A blazing fast inference solution for text embeddings models

Next Generation Agentic Proxy for AI Agents and MCP servers

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

AI Agent that handles engineering tasks end-to-end: integrates with developers’ tools, plans, executes, and iterates until it achieves a successful result.

Semantic version control => entity-level diffs, blame, and impact analysis on top of git. 28 languages via tree-sitter. Built for coding agents.

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.

BitFun is a desktop-grade Agent runtimeand a ready-to-use suite of desktop Agent applications.with built-in Code Agent 、 Cowork Agent、Computer Use. It has memory, personality, and the ability to evolve over time