Awesome Opensource Ai

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

Trainable, memory-efficient, and GPU-friendly PyTorch reproduction of AlphaFold 2

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

Semantic version control => entity-level diffs, blame, and impact analysis on top of git. 28 languages via tree-sitter. Built for coding agents.

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Build production-ready AI agents in both Python and Typescript.

II-Agent: a new open-source framework to build and deploy intelligent agents

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — reads images, abliterated), Gemma 4 31B, Qwen 3.5 122B (65 tok/s), DeepSeek V4 Flash (1M ctx). Private, offline, airgap-ready. Built for NDA / legal / healthcare workflows.

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

Scalable and efficient data transformation framework - backwards compatible with dbt.

RAG Web UI is an intelligent dialogue system based on RAG (Retrieval-Augmented Generation) technology.

JAX-based neural network library

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Dead simple FLUX LoRA training UI with LOW VRAM support

🔅 Shapash: User-friendly Explainability and Interpretability to Develop Reliable and Transparent Machine Learning Models

Stateful agents that are like people, with memory, identity, and the ability to learn and adapt

Open-source deep-learning framework for building, training, and fine-tuning deep learning models using state-of-the-art Physics-ML methods

Cortex - Generates interactive API documentation, typed SDKs, and MCP servers from OpenAPI, AsyncAPI, GraphQL, gRPC, OpenRPC, and Markdown.

The Security Toolkit for LLM Interactions

llama.cpp fork with additional SOTA quants and improved performance

OneTrainer is a one-stop solution for all your Diffusion training needs.

Fast, Accurate, Lightweight Python library to make State of the Art Embedding

Bonsai Demo

Skywork-R1V is an advanced multimodal AI model series developed by Skywork AI, specializing in vision-language reasoning.

Playwright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.

🦜💬 Web app for interacting with any LangGraph agent (PY & TS) via a chat interface.

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Templates and workflow for generating PRDs, Tech Designs, and MVP and more using LLMs for AI IDEs

Postgres extension for vector search (DiskANN), complements pgvector for performance and scale. Postgres OSS licensed.

Visualize and compare datasets, target values and associations, with one line of code.

(Crystal is now Nimbalyst) Run multiple Codex and Claude Code AI sessions in parallel git worktrees. Test, compare approaches & manage AI-assisted development workflows in one desktop app.

Open source, local, and self-hosted Amazon Echo/Google Home competitive Voice Assistant alternative

PentestAgent is an AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows.

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

An open-source visual programming environment for battle-testing prompts to LLMs.

Multi-framework streaming Markdown renderers for AI apps: Vue/Nuxt, React/Next.js, Svelte, and Angular, with Mermaid, KaTeX, stream-diffs code blocks, safe HTML, and low-jitter updates.

A framework for prompt tuning using Intent-based Prompt Calibration

Inspect: A framework for large language model evaluations

Deepnote is a drop-in replacement for Jupyter with an AI-first design, sleek UI, new blocks, and native data integrations. Use Python, R, and SQL locally in your favorite IDE, then scale to Deepnote cloud for real-time collaboration, Deepnote agent, and deployable data apps. https://deepnote.com/

PyTorch native quantization for training and inference

DeepTeam is a framework to red team LLMs and AI agents.

pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

Elegant easy-to-use neural networks + scientific computing in JAX. https://docs.kidger.site/equinox/

Data manipulation and transformation for audio signal processing, powered by PyTorch

Kubernetes-native Job Queueing