Awesome Llm

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

A high-throughput and memory-efficient inference and serving engine for LLMs

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

SGLang is a high-performance serving framework for large language models and multimodal models.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Efficient Triton Kernels for LLM Training

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

Harness LLMs with Multi-Agent Programming

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

Make your LLM agent and chat with it simple and fast!