Awesome Opensource Ai

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Learn it. Build it. Ship it for others.

The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.

Extremely fast Query Engine for DataFrames, written in Rust

⌥ Coding agent with the IDE wired in. Built by Stencil Labs.

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

Search infrastructure for AI

High performance coding agent harness written in rust

Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Cloud-native OSS search engine for observability

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

One Postgres for your application data, full-text search, vector retrieval, and aggregations. Home of the pg_search extension.

⚙️🦀 Build modular and scalable LLM Applications in Rust

🧱 Easy fast local-first microVM runtime and library

A Datacenter Scale Distributed Inference Serving Framework

Fast, flexible LLM inference

HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

Free, ultrafast Copilot alternative for Vim and Neovim

Next Generation Agentic Proxy for AI Agents and MCP servers

A Rust machine learning framework.

Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local).

Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.

Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.

Open-source AI coding agent and agent runtime: one binary, any model, MCP-native. Runs in terminal, CI, or as a daemon.

Local-first Rust TUI/CLI for auditing AI coding-agent sessions: cost, tokens, latency, failures, and health｜本地运行的 Rust TUI/CLI，审计 AI 编程 Agent 会话的成本、Token、延迟、失败与健康度

Intent as Code | the workflow language for AI. One file, 4 verbs, one Rust binary. Local-first, any model, AGPL-3.0. 🦋