Awesome Opensource Ai

Python bindings for llama.cpp

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Hackable and optimized Transformers building blocks, supporting a composable construction.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

A unified framework for machine learning with time series

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

High-speed Large Language Model Serving for Local Deployment

Bayesian Modeling and Probabilistic Programming in Python

cuDF - GPU DataFrame Library

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

the LLM vulnerability scanner

Containers for machine learning

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

AutoML library for deep learning

ModelScope: bring the notion of Model-as-a-Service to life.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

No description.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

AI Toolkit for Healthcare Imaging

Apache Beam is a unified programming model for Batch and Streaming data processing.

Build effective agents using Model Context Protocol and simple workflow patterns

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Accessible large language models via k-bit quantization for PyTorch.

slime is an LLM post-training framework for RL Scaling.

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

A vector search SQLite extension that runs anywhere!

Unified framework for robot learning built on NVIDIA Isaac Sim

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A Datacenter Scale Distributed Inference Serving Framework

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

Utilities intended for use with Llama models.

An open source python library for automated feature engineering

Fast, flexible LLM inference

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

The Open Source Feature Store for AI/ML

Flax is a neural network library for JAX that is designed for flexibility.

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Fit interpretable models. Explain blackbox machine learning.

Modeling, training, eval, and inference code for OLMo

Efficient Triton Kernels for LLM Training

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.