Awesome Opensource Ai

An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

Open Source Computer Vision Library

DuckDB is an analytical in-process SQL database management system

A library for efficient similarity search and clustering of dense vectors.

Official inference framework for 1-bit LLMs

Cross-platform, customizable ML solutions for live and streaming media.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

MLX: An array framework for Apple silicon

Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences

Distribute and run LLMs with a single file.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

ncnn is a high-performance neural network inference framework optimized for the mobile platform

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

A lightweight, lightning-fast, in-process vector database

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Tensor library for machine learning

Multi-Joint dynamics with Contact. A general purpose physics simulator.

Open-source simulator for autonomous driving research.

Open3D: A Modern Library for 3D Data Processing

Open-source search database for full-text, vector, and hybrid search with real-time indexing and SQL.

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Point Cloud Library (PCL)

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

High-speed Large Language Model Serving for Local Deployment

cuDF - GPU DataFrame Library

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

lightweight, standalone C++ inference engine for Google's Gemma models.

Fit interpretable models. Explain blackbox machine learning.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Header-only C++/python library for fast approximate nearest neighbors

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Fast inference engine for Transformer models

Webots Robot Simulator

RTAB-Map library and standalone application

A retargetable MLIR-based machine learning compiler and runtime toolkit.

A flexible, high-performance 3D simulator for Embodied AI research.

Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.

Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.

llama.cpp fork with additional SOTA quants and improved performance

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

Community maintained hardware plugin for vLLM on Ascend

nanoflann: a C++11 header-only library for Nearest Neighbor (NN) search with KD-trees

Production-grade 3D gaussian splatting with CPU/GPU support for Windows, Mac and Linux 🚀