A Datacenter Scale Distributed Inference Serving Framework
Appears on
Quick read
Latest capture 2026-09-09 03:04
Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.
219 paths
Agent instructions and tool configuration found in this repository.
Agent instructions 42
Agent workspace 132
Claude Code 44
CodeRabbit
195 more paths detected.
7 observed captures since 2026-05-25. Observed captures are shown by default.
Stars from first capture +925
Observed captures only
All tracked data
Observed snapshots
Observed snapshots
Nearest indexed repositories by embedding similarity.
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Achieve state of the art inference performance with modern accelerators on Kubernetes
Build, run and scale AI agents like API and microservices
Low-code framework for building custom LLMs, neural networks, and other AI models
