Awesome Opensource Ai

Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9

Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

Unity MCP acts as a bridge between AI assistants and your Unity Editor. Give your LLM tools to manage assets, control scenes, edit scripts, and automate tasks within Unity.

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D avatar running locally across platforms

Graph-Native Infrastructure for Context and Accountable AI Systems

🚀 PR Agent: The Original Open-Source PR Reviewer. This project is not the Qodo free tier.

The Context Platform for your Data and AI Stack

No description.

Trae Agent is an LLM-based agent for general purpose software engineering tasks.

AI Observability & Evaluation

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

A vector search SQLite extension that runs anywhere!

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

The Open Source Feature Store for AI/ML

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

an ambient intelligence library

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Ecommerce Search and Discovery - marqo.ai

Minimal CLI coding agent by Mistral

Agenta is a workspace where you and your team build agents and automations.

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified endpoint with centralized discovery, guardrails and management. Optimizes Agent & Tool calling, and supports plugins.

Generative models for conditional audio generation

Open-source security automation platform for teams and AI agents

Build production-ready AI agents in both Python and Typescript.

II-Agent: a new open-source framework to build and deploy intelligent agents

Scalable and efficient data transformation framework - backwards compatible with dbt.

Dead simple FLUX LoRA training UI with LOW VRAM support

Official, AWS-supported MCP servers, skills, and plugins to help AI agents build on AWS

An AI-powered agentic red team framework that automates offensive security operations, from reconnaissance to exploitation to post-exploitation, with zero human intervention.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

An implementation of chunked, compressed, N-dimensional arrays for Python.

Developer Asset Hub for NVIDIA Nemotron — A one-stop resource for training recipes, usage cookbooks, datasets, and full end-to-end reference examples to build with Nemotron models

Scalable toolkit for efficient model reinforcement

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.