Awesome Chatgpt

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Incremental engine for long horizon agents 🌟 Star if you like it!

Pocket Flow: 100-line LLM framework. Let Agents build Agents!

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.

The fullstack MCP framework to develop MCP Apps for ChatGPT / Claude & MCP Servers for AI Agents.

An Open-Source Asynchronous Coding Agent

MiniCPM5: SOTA on-device LLMs, small yet powerful.

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

Production ready toolkit to run AI locally

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

Cybersecurity AI (CAI), the framework for AI Security

UFO³: Weaving the Digital Agent Galaxy

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

FreeAskInternet is a completely free, PRIVATE and LOCALLY running search aggregator & answer generate using MULTI LLMs, without GPU needed. The user can ask a question and the system will make a multi engine search and combine the search result to LLM and generate the answer based on search results. It's all FREE to use.

The Open Standard for Generative UI

Build effective agents using Model Context Protocol and simple workflow patterns

An Autonomous LLM Agent for Complex Task Solving

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Build autonomous AI agents in Python.

Repo to accompany my mastering LLM engineering course

File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.

AutoClip : AI-powered video clipping and highlight generation · 一款智能高光提取与剪辑的二创工具

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

Reverse Engineering: Decompiling Binary Code with Large Language Models

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Memory library for building stateful agents

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

DeepAudit：人人拥有的 AI 黑客战队，让漏洞挖掘触手可及。国内首个开源的代码漏洞挖掘多智能体系统。小白一键部署运行，自主协作审计 + 自动化沙箱 PoC 验证。支持 Ollama 私有部署 ，一键生成报告。支持中转站。​让安全不再昂贵，让审计不再复杂。

🔥 基于大模型和 RAG 的智能问数系统，对话式数据分析神器。Text-to-SQL Generation via LLMs using RAG.

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

Free open source crypto trading bot to automate AI, Grid, DCA and TradingView strategies on Binance, Hyperliquid and 15+ exchanges, with a simple interface.

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Open-source context retrieval layer for AI agents

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

ChatGPT官网接口纯协议的逆向实现，支持GPT-Image-2模型、文本模型，兼容OpenAI接口协议，在线批量生图/编辑图，号池管理，支持可编辑PPT/PSD文件逆向，支持导入CPA、sub2api号池 、支持接入Cherry Studio、New Api 等软件

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

Local-first AI agent workspace for coding, writing, design, research, and automation — one runtime for desktop GUI and TUI.

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.