High-speed Large Language Model Serving for Local Deployment
Appears on
Quick read
Latest capture 2026-09-10 03:09
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +293
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
AirLLM 70B inference with single 4GB GPU
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models
FlashInfer: Kernel Library for LLM Serving
Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
QLoRA: Efficient Finetuning of Quantized LLMs
