Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Appears on
Quick read
Latest capture 2026-09-27 03:08
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
7 observed captures since 2026-05-27. Observed captures are shown by default.
Stars from first capture +62
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
llama.cpp fork with additional SOTA quants and improved performance
Bonsai Demo
Fast, flexible LLM inference
Minimalist ML framework for Rust
LLM speculative inference server for heterogeneous hardware & consumer GPUs
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
