EricLBuehler/candle-vllm
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Minimalist ML framework for Rust
Quick read
Latest capture 2026-09-10 03:05
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +672
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Official inference framework for 1-bit LLMs
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
Bonsai Demo
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
Rust bindings for the C++ api of PyTorch.