Search awesome repositories

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

No description.

A high-throughput and memory-efficient inference and serving engine for LLMs

No description.

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

Making large AI models cheaper, faster and more accessible

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain

DSPy: The framework for programming—not prompting—language models

🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.

SGLang is a high-performance serving framework for large language models and multimodal models.

Integrate cutting-edge LLM technology quickly and easily into your apps

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Ongoing research training transformer models at scale

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

A framework for few-shot evaluation of language models.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Use ChatGPT On Wechat via wechaty

Minimal reproduction of DeepSeek R1-Zero

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Access large language models from the command-line

Go ahead and axolotl questions

Kimi K2 is the large language model series developed by Moonshot AI team

The AI Compute Platform for frontier teams. SkyPilot turns fragmented AI compute into one AI supercomputer, so frontier AI teams build custom intelligence faster.

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)