Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
1,666 repos currently saved from this list.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
The ultimate LLM/AI application development framework in Go.
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
The simplest way to run LLaMA on your local machine
📋 A list of open LLMs available for commercial use.
HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.
Capture first. Organize later. A local-first Markdown app that turns scattered records into clear notes with AI.
Pocket Flow: Codebase to Tutorial
ChatGPT DAN, Jailbreaks prompt
LangGPT: Empowering everyone to become a prompt expert! 🚀 📌 结构化提示词(Structured Prompt)提出者 📌 元提示词(Meta-Prompt)发起者 📌 最流行的提示词落地范式 | Language of GPT The pioneering framework for structured & meta-prompt design 10,000+ ⭐ | Battle-tested by thousands of users worldwide Created by 云中江树
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
A Claude skill that writes the accurate prompts for any AI tool. Zero tokens or credits wasted. Full context and memory retention
🏠 将小爱音箱接入 ChatGPT 和豆包,改造成你的专属语音助手。
Access large language models from the command-line
Build Conversational AI in minutes ⚡️
Go ahead and axolotl questions
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently.
The official GitHub page for the survey paper "A Survey of Large Language Models".
🔍大模型应用开发实战一:RAG 技术全栈指南,在线阅读地址:https://datawhalechina.github.io/all-in-rag/
A straightforward method for training your LLM, from downloading data to generating text.
Retrieval and Retrieval-augmented LLMs
Trae Agent is an LLM-based agent for general purpose software engineering tasks.
Expose your FastAPI endpoints as Model Context Protocol (MCP) tools, with Auth!
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/
Low-code framework for building custom LLMs, neural networks, and other AI models
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Incremental engine for long horizon agents 🌟 Star if you like it!
The best way to get AI coding agents to solve hard problems in complex codebases.
Practical patterns, starters & CLI tools for loop engineering with AI coding agents. Design systems that prompt and orchestrate agents (inspired by Addy Osmani and Boris Cherny). Includes loop-audit, loop-init, loop-cost.
Connect your users to their apps
Formerly KrillinAI. Open-source AI workspace for creators, powered by Codex. Create videos, images, voice, avatars, translations, and edits with Agents in one place.
🤖 Multi-platform IM AI Agent for Telegram, WhatsApp, Lark, and WeChat. Connects ChatGPT / Claude / Kimi / DeepSeek / Ollama / Pi for auto-replies, community analysis, contact management, and inactive-friend detection.
Pocket Flow: 100-line LLM framework. Let Agents build Agents!
Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.
Open-source agentic workspace enterprises can make their own. Connect the systems you already run — 100+ integrations, MCP, chat tools, apps, browser, local files — with shared memory. Any agent (Claude Code, Codex), any model, or BYOK. Set up in clicks, not months. Local-first: your data never leaves your machines.
Bytebot is a self-hosted AI desktop agent that automates computer tasks through natural language commands, operating within a containerized Linux desktop environment.
QLoRA: Efficient Finetuning of Quantized LLMs
利用 AI 大模型,一键解说并剪辑视频
The open source codebase powering HuggingChat
https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习|数据合成
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
⭕ Share quick reference cheat sheet for developers.
Web dashboard for Hermes Agent — multi-platform AI chat, session management, scheduled jobs, usage analytics
Official inference library for Mistral models