Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Appears on
Quick read
Latest capture 2026-10-17 03:16
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
2 observed captures since 2026-09-05. Observed captures are shown by default.
Stars from first capture +3
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Fast, flexible LLM inference
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
AirLLM 70B inference with single 4GB GPU
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Go ahead and axolotl questions
Official inference library for Mistral models
