Andyyyy64/whichllm
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
Hundreds of models & providers. One command to find what runs on your hardware.
Appears on
Quick read
Latest capture 2026-10-17 03:08
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
1 path
Agent instructions and tool configuration found in this repository.
Agent instructions
2 observed captures since 2026-09-04. Observed captures are shown by default.
Stars from first capture +3140
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
No description.
AirLLM 70B inference with single 4GB GPU
Achieve state of the art inference performance with modern accelerators on Kubernetes