Sign in
← Back to search
github Not archived

intentee/paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

0 awesome lists

Quick read

Stars
1,677
Forks
98
Open issues
30
Commits
1,261

Activity and growth

Latest capture 2026-10-16 04:32

Stars · last 7 days
+2 +0.1%
Commits · last 7 days
0 0.0%
Stars since tracking
+93
Stored snapshots
69

Classification

Topics

#ai #llamacpp #llm #llmops #load-balancer

Technology stack

Actix Web pytest React

Metadata

Language
Rust
License
Apache-2.0
Default branch
main
Created
2024-04-27
First commit
2024-04-27
Last pushed
2026-10-15
GitHub updated
2026-10-16
Last synced
2026-10-16 04:32
Stack scanned
2026-10-16 04:32
Archived
No

Archive status reflects the last catalog sync, not a maintenance assessment. Check recent releases, issue responses, and fit for your project with the repository shortlisting checklist.

Sign in to like intentee/paddler
README Open website View on GitHub

AI development signals

36 paths

Agent instructions and tool configuration found in this repository.

Claude Code 36

View paths

12 more paths detected.

Growth history

Tracked growth

69 observed captures since 2026-06-02. Observed captures are shown by default.

Stars from first capture +93

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

PaddlePaddle/PaddleOCR

Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.

89,097 stars
Python 3 awesome lists

getumbrel/llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

10,936 stars
TypeScript 3 awesome lists

mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

49,328 stars
Go 6 awesome lists

llm-d/llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

4,473 stars
Shell 2 awesome lists

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

11,753 stars
Python 3 awesome lists