Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
A high-throughput and memory-efficient inference and serving engine for LLMs
Examples and guides for using the OpenAI API
LlamaIndex is the document processing platform for AI
aider is AI pair programming in your terminal
In-depth tutorials on LLMs, RAGs and real-world AI agent applications.
OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
A modular graph-based Retrieval-Augmented Generation (RAG) system
📚 从零开始构建大模型
《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调(全参数/Lora)、部署国内外开源大模型(LLM)/多模态大模型(MLLM)教程
基于多智能体LLM的中文金融交易框架 - TradingAgents中文增强版
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?
本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
面向开发者的 LLM 入门教程,吴恩达大模型系列课程中文版
50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.
Automate browser based workflows with AI
FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.
Tongyi Deep Research, the Leading Open-source Deep Research Agent
Sample code and notebooks for Generative AI on Google Cloud, with Gemini Enterprise Agent Platform
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
Retrieval and Retrieval-augmented LLMs
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.
Running large language models on a single GPU for throughput-oriented scenarios.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.
Repo to accompany my mastering LLM engineering course
LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base. Register here 👇🏼
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Postgres with GPUs for ML/AI apps.
Large Action Model framework to develop AI Web Agents
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
Ecommerce Search and Discovery - marqo.ai
Zep | Examples, Integrations, & More
《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
The first AI agent that builds permissionless integrations through reverse engineering platforms' internal APIs.
General technology for enabling AI capabilities w/ LLMs and MLLMs
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦𝘢𝘥𝘪𝘯𝘨 𝘮𝘢𝘵𝘦𝘳𝘪𝘢𝘭𝘴
Jupyter Notebooks to help you get hands-on with Pinecone vector databases
Python & JS/TS SDK for running AI-generated code/code interpreting in your AI app
Mastering Applied AI, One Concept at a Time
LangServe 🦜️🏓
Notebooks & Example Apps for Search & AI Applications with Elasticsearch
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
Text to video generator in the brainrot form. Learn about any topic from your favorite personalities 😼.
Self-paced bootcamp on Generative AI. Tutorials on ML fundamentals, Ollama, LLMs, RAGs, LangChain, LangGraph, Fine-tuning, DSPy & AI Agents (CrewAI), (Using ChatGPT, gpt-oss, Claude, Qwen, Gemma, Llama, Gemini)