Awesome Opensource Ai

An Open Source Machine Learning Framework for Everyone

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

LLM inference in C/C++

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A high-throughput and memory-efficient inference and serving engine for LLMs

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

Open Source Computer Vision Library

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

Ultralytics YOLO26, YOLO11, YOLOv8 — object detection, instance segmentation, semantic segmentation, image classification, pose estimation, object tracking

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

DuckDB is an analytical in-process SQL database management system

A library for efficient similarity search and clustering of dense vectors.

Official inference framework for 1-bit LLMs

Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

SGLang is a high-performance serving framework for large language models and multimodal models.

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

The fundamental package for scientific computing with Python.

Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

MLX: An array framework for Apple silicon

Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences

A game theoretic approach to explain the output of any machine learning model.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Graph Neural Network Library for PyTorch

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Universal LLM Deployment Engine with ML Compilation

Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Open standard for machine learning interoperability

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

Development repository for the Triton language and compiler

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Datasets, Transforms and Models specific to Computer Vision

A lightweight, lightning-fast, in-process vector database

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Tensor library for machine learning

Multi-Joint dynamics with Contact. A general purpose physics simulator.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Open-source simulator for autonomous driving research.

A framework for building realtime voice AI agents 🤖🎙️📹

Open3D: A Modern Library for 3D Data Processing

Open Machine Learning Compiler Framework

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer