Optimized vLLM deployment for NVIDIA Blackwell (RTX 5090) on Linux Kernel 6.14. Resolves SM_120 kernel incompatibilities, P2P deadlocks, and memory fragmentation for high-performance LLM inference.
Appears on
Quick read
Latest capture 2026-09-07 03:08
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
0 paths
Agent instructions and tool configuration found in this repository.
No config files detected.
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +1
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Achieve state of the art inference performance with modern accelerators on Kubernetes
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
LLM speculative inference server for heterogeneous hardware & consumer GPUs
