A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Appears on
Quick read
Latest capture 2026-09-10 03:06
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
38 paths
Agent instructions and tool configuration found in this repository.
Agent instructions
Agent workspace 11
Claude Code 25
CodeRabbit
14 more paths detected.
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +1021
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Go ahead and axolotl questions
Ongoing research training transformer models at scale
Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Minimalistic large language model 3D-parallelism training
