Large-scale LLM inference engine
Appears on
Quick read
Latest capture 2026-06-27 03:11
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
2 paths
Agent instructions and tool configuration found in this repository.
Gemini CLI 2
4 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +33
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads
Go ahead and axolotl questions
Low-code framework for building custom LLMs, neural networks, and other AI models
The official API server for Exllama. OAI compatible, lightweight, and fast.
