Awesome Opensource Ai

Optimize prompts, code, and more with AI-powered Reflective Optimization

FlashInfer: Kernel Library for LLM Serving

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

Upserts, Deletes And Incremental Processing on Big Data.

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

an ambient intelligence library

A scikit-learn compatible neural network library that wraps PyTorch

Open-source scientific and technical publishing system built on Pandoc.

A system for quickly generating training data with weak supervision

A simple SWE style browser agent framework that achieves SOTA results on long horizon web tasks.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

HelixDB is an OLTP graph database with native vector and full-text search built in Rust on Object Storage.

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

A treasure chest for visual classification and recognition powered by PaddlePaddle

The CLI and skills that turn any coding assistant into an expert at creating, evaluating, and deploying AI agents on Google Cloud.

Democratizing Reinforcement Learning for LLMs

Chronos: Pretrained Models for Time Series Forecasting

PyTorch native post-training library

🐢 Open-Source Evaluation & Testing library for LLM Agents

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

A PyTorch native platform for training generative AI models

Gemma open-weight LLM library, from Google DeepMind

Model interpretability and understanding for PyTorch

CUDA accelerated rasterization of gaussian splatting

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Supercharge Your Model Training

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Header-only C++/python library for fast approximate nearest neighbors

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

cuML - RAPIDS Machine Learning Library

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Framework for evaluating and improving agents

A blazing fast inference solution for text embeddings models

Ecommerce Search and Discovery - marqo.ai

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

On-device AI across mobile, embedded and edge for PyTorch

Time series forecasting with PyTorch

Lightning ⚡️ fast forecasting with statistical and econometric models.

An Engine-Agnostic Deep Learning Framework in Java

Agenta is a workspace where you and your team build agents and automations.

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Next Generation Agentic Proxy for AI Agents and MCP servers

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Align Anything: Training All-modality Model with Feedback

Fast inference engine for Transformer models