Awesome Opensource Ai

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

Open-source scientific and technical publishing system built on Pandoc.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Democratizing Reinforcement Learning for LLMs

🐢 Open-Source Evaluation & Testing library for LLM Agents

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

lakeFS - Data version control for your data lake | Git for data

Astronomy and astrophysics core library

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

Probabilistic time series modeling in Python

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Framework for evaluating and improving agents

A blazing fast inference solution for text embeddings models

Ecommerce Search and Discovery - marqo.ai

Minimal CLI coding agent by Mistral

Lightning ⚡️ fast forecasting with statistical and econometric models.

Agenta is a workspace where you and your team build agents and automations.

Next Generation Agentic Proxy for AI Agents and MCP servers

Relax! Flux is the ML library that doesn't make you tensor

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Reliable Multi-Agent Orchestration Framework

A light-weight, flexible, and expressive statistical data testing library

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top!

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

A system for agentic LLM-powered data processing and ETL

Harness LLMs with Multi-Agent Programming

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Simple, safe way to store and distribute tensors

Superfast AI decision making and intelligent processing of multi-modal data.

A library for mechanistic interpretability of GPT-style language models

Generative models for conditional audio generation

Open-source security automation platform for teams and AI agents

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

The Harness of Harnesses: a trusted, persistent, self-evolving multi-agent ecosystem for all-domain collaboration.

The best OSS video generation models, created by Genmo

Open-source multimodal retrieval engine (Morphik Core)

Quickly and accurately render even the largest data.

Evaluation and Tracking for LLM Experiments and AI Agents

MTEB: State-of-the-art evaluation of embeddings across languages and modalities