Awesome Opensource Ai

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

Inspect: A framework for large language model evaluations

DeepTeam is a framework to red team LLMs and AI agents.

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

A library for debugging/inspecting machine learning classifiers and explaining their predictions

Minimalistic large language model 3D-parallelism training

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

Community maintained hardware plugin for vLLM on Ascend

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation to GPU/TPU/CPU.

An Open Standard for lineage metadata collection

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Machine learning metrics for distributed, scalable PyTorch applications.

SDG is a specialized framework designed to generate high-quality structured tabular data.

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Data Contracts engine for the modern data stack. https://www.soda.io

Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app

Bionic is sovereign Agentic AI for the enterprise — Runs on-premise and can securely work with your sensitive data and systems.

Fully open data curation for reasoning models

A Python package to assess and improve fairness of machine learning models.

Feature engineering and selection open-source Python library compatible with sklearn.

Self-learning agent browser

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

cuGraph - RAPIDS Graph Analytics Library

VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo

TFX is an end-to-end platform for deploying production ML pipelines

Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable. https://docs.kidger.site/diffrax/

An implementation of chunked, compressed, N-dimensional arrays for Python.

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Enforce the output format (JSON Schema, Regex etc) of a language model

Agentic RL Training at Scale

Scalable toolkit for efficient model reinforcement

:robot: MoveIt for ROS 2

ContextGem: Effortless LLM extraction from documents

Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

[ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Fast, Flexible and Portable Structured Generation

Exploratory analysis of Bayesian models with Python

Large-scale LLM inference engine