Awesome Opensource Ai

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

Kimi Code CLI is your next CLI agent.

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Point Cloud Library (PCL)

Multi-Agent Harness for Production AI

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Open source annotation tool for machine learning practitioners.

Fast and Accurate ML in 3 Lines of Code

Python bindings for llama.cpp

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.

MiniCPM5: SOTA on-device LLMs, small yet powerful.

Hackable and optimized Transformers building blocks, supporting a composable construction.

Modin: Scale your Pandas workflows by changing a single line of code

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

Build, Manage and Deploy AI/ML Systems

A unified framework for machine learning with time series

tiny vision language model

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

Cybersecurity AI (CAI), the framework for AI Security

High-speed Large Language Model Serving for Local Deployment

Bayesian Modeling and Probabilistic Programming in Python

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

the LLM vulnerability scanner

Containers for machine learning

🤖 AI Gateway | AI Native API Gateway

Easy-to-use image segmentation library with awesome pre-trained model zoo, supporting wide-range of practical tasks in Semantic Segmentation, Interactive Segmentation, Panoptic Segmentation, Image Matting, 3D Segmentation, etc.

AutoML library for deep learning

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

Apache Iceberg

ModelScope: bring the notion of Model-as-a-Service to life.

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

No description.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

🧙 Build, run, and manage data pipelines for integrating and transforming data.

[NeurIPS 2024] Depth Anything V2. A More Capable Foundation Model for Monocular Depth Estimation

AI Toolkit for Healthcare Imaging

Apache Beam is a unified programming model for Batch and Streaming data processing.

Build effective agents using Model Context Protocol and simple workflow patterns