Awesome Opensource Ai

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

Accessible large language models via k-bit quantization for PyTorch.

slime is an LLM post-training framework for RL Scaling.

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

A vector search SQLite extension that runs anywhere!

Unified framework for robot learning built on NVIDIA Isaac Sim

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

A Datacenter Scale Distributed Inference Serving Framework

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

No description.

Utilities intended for use with Llama models.

An open source python library for automated feature engineering

Adding guardrails to large language models.

SkyReels-V2: Infinite-length Film Generative model

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

The Open Source Feature Store for AI/ML

可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Yuxi = Cloud Agents + Knowledge RAG, Self-hosted knowledge agent platform for RAG, knowledge graphs and multi-agent workflows.

Flax is a neural network library for JAX that is designed for flexibility.

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

GLM-5: From Vibe Coding to Agentic Engineering

The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

XERJ is the new way for AI to search data. Its autoindex capability activates agents to know your data without the token waste of grep and sed. One command indexes code, docs, logs and PDFs for search, RAG, security audits and agent memory, using 40x fewer tokens than grep. Elasticsearch compatible, so existing clients just work.

lightweight, standalone C++ inference engine for Google's Gemma models.

Democratizing Deep-Learning for Drug Discovery, Quantum Chemistry, Materials Science and Biology

Fit interpretable models. Explain blackbox machine learning.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

No description.

Modeling, training, eval, and inference code for OLMo

the portable Python dataframe library

Efficient Triton Kernels for LLM Training

Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Optimize prompts, code, and more with AI-powered Reflective Optimization

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

FlashInfer: Kernel Library for LLM Serving

TensorFlow documentation

🐬DeepChat - A smart assistant that connects powerful AI to your personal world

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

AI Agent Governance Toolkit — Policy enforcement, zero-trust identity, execution sandboxing, and reliability engineering for autonomous AI agents. Covers 10/10 OWASP Agentic Top 10.

A query and indexing engine for Redis, providing secondary indexing, full-text search, vector similarity search and aggregations.

Upserts, Deletes And Incremental Processing on Big Data.