Awesome Opensource Ai

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

A scikit-learn compatible neural network library that wraps PyTorch

Open-source scientific and technical publishing system built on Pandoc.

A system for quickly generating training data with weak supervision

An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.

A treasure chest for visual classification and recognition powered by PaddlePaddle

PyTorch native post-training library

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

A PyTorch native platform for training generative AI models

Gemma open-weight LLM library, from Google DeepMind

⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org

Robust recipes to align language models with human and AI preferences

CUDA accelerated rasterization of gaussian splatting

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

lakeFS - Data version control for your data lake | Git for data

Supercharge Your Model Training

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Header-only C++/python library for fast approximate nearest neighbors

Astronomy and astrophysics core library

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

Probabilistic time series modeling in Python

Visualizer for pandas data structures

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

Framework for evaluating and improving agents

A blazing fast inference solution for text embeddings models

Ecommerce Search and Discovery - marqo.ai

On-device AI across mobile, embedded and edge for PyTorch

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

Lightning ⚡️ fast forecasting with statistical and econometric models.

An Engine-Agnostic Deep Learning Framework in Java

Agenta is a workspace where you and your team build agents and automations.

Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

Align Anything: Training All-modality Model with Feedback

Fast inference engine for Transformer models

A fast inference library for running LLMs locally on modern consumer-class GPUs

Notebooks using the Hugging Face libraries 🤗

Webots Robot Simulator

A repository for storing models that have been inter-converted between various frameworks. Supported frameworks are TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, CoreML.

Reliable Multi-Agent Orchestration Framework

Achieve state of the art inference performance with modern accelerators on Kubernetes