DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Appears on
Quick read
Latest capture 2026-10-06 10:51
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
1 path
Agent instructions and tool configuration found in this repository.
Agent instructions
1 observed capture since 2026-10-06. Observed captures are shown by default.
Stars from first capture 0
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
LLM speculative inference server for heterogeneous hardware & consumer GPUs
No description.
SGLang is a high-performance serving framework for large language models and multimodal models.
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
The good ol' Forge WebUI, now updated with new features~
