Awesome Opensource Ai

Data manipulation and transformation for audio signal processing, powered by PyTorch

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

A training framework for Stable Baselines3 reinforcement learning agents, with hyperparameter optimization and pre-trained agents included.

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

Minimalistic large language model 3D-parallelism training

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

[NeurIPS 2025] OmniSVG is the first family of end-to-end multimodal SVG generators that leverage pre-trained Vision-Language Models (VLMs), capable of generating complex and detailed SVGs, from simple icons to intricate anime characters.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

Machine learning metrics for distributed, scalable PyTorch applications.

SDG is a specialized framework designed to generate high-quality structured tabular data.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Data Contracts engine for the modern data stack. https://www.soda.io

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Fully open data curation for reasoning models

A Python package to assess and improve fairness of machine learning models.

Feature engineering and selection open-source Python library compatible with sklearn.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

TFX is an end-to-end platform for deploying production ML pipelines

Helios: Real Real-Time Long Video Generation Model

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

An implementation of chunked, compressed, N-dimensional arrays for Python.

Toward High-Accuracy Open-Source Biomolecular Structure Prediction.

Enforce the output format (JSON Schema, Regex etc) of a language model

Agentic RL Training at Scale

Scalable toolkit for efficient model reinforcement

ContextGem: Effortless LLM extraction from documents

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

[CVPR 2025] Magma: A Foundation Model for Multimodal AI Agents

Interpretability and explainability of data and machine learning models

Reference implementations of MLPerf® training benchmarks

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

Synthetic data curation for post-training and structured data extraction

The good ol' Forge WebUI, now updated with new features~

Lightweight and extensible compatibility layer between dataframe libraries!

Automated Machine Learning on Kubernetes

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

MMaDA - Open-Sourced Multimodal Large Diffusion Language Models (dLLMs with block diffusion, mixed-CoT, unified RL)

Machine learning with dataframes

A fast and lightweight framework for creating decentralized agents with ease.

A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.