Sign in
← All awesome lists Search these repos

Awesome List

Awesome Opensource Ai

Curated list of the best truly open-source AI projects, models, tools, and infrastructure. Daily updated.

alvinreal/awesome-opensource-ai #agents #ai #artificial-intelligence #awesome #awesome-list #generative-ai #llm #machine-learning #mlops #open-source #open-source-ai #rag
Open GitHub
List stars
4,893
README repos
1,095
Indexed repos
962
List commits
654
Forks
721
Open issues
25

Tracked list growth

GitHub stars and default-branch commits for alvinreal/awesome-opensource-ai.

Latest scan 2026-10-17 10:50

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

8 repos matching these filters.

Topic: model-serving
Latest repo push 2026-10-17

Filter this list

Search within Awesome Opensource Ai or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

AI dev
Stack
Python Axum FastAPI pytest Starlette Cargo CMake PEP 517
GitHub topics
#amd #blackwell #cuda #deepseek #deepseek-v3 #gpt
Updated
2026-10-09
Lists
4 list mentions
First commit
2023-02-09
License
Apache-2.0
Issues
8,640 open
Sign in to like vllm-project/vllm
93,418
stars
Forks
23,151
Commits
22,725 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Stack
Python FastAPI pytest Starlette Tornado PDM pip uv
GitHub topics
#ai-inference #deep-learning #generative-ai #inference-platform #llm #llm-inference
Updated
2026-08-28
Lists
2 list mentions
First commit
2019-04-02
License
Apache-2.0
Issues
218 open
Sign in to like bentoml/BentoML
8,822
stars
Forks
1,024
Commits
3,761 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
kserve/kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

AI dev
Stack
Go Cobra FastAPI Gin gRPC Go Go modules PEP 517 pip
GitHub topics
#artificial-intelligence #cncf #genai #hacktoberfest #istio #k8s
Updated
2026-09-09
Lists
1 list mention
First commit
2019-03-27
License
Apache-2.0
Issues
214 open
Sign in to like kserve/kserve
5,868
stars
Forks
1,658
Commits
2,574 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
ModelTC/LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Stack
Python FastAPI pip
GitHub topics
#deep-learning #gpt #llama #llm #model-serving #nlp
Updated
2026-09-10
Lists
2 list mentions
First commit
2023-07-22
License
Apache-2.0
Issues
159 open
Sign in to like ModelTC/LightLLM
4,276
stars
Forks
362
Commits
977 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
GitHub
mlrun/mlrun

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environment and automates the delivery of production data, ML pipelines, and online applications.

AI dev
Stack
Python FastAPI gRPC Go Starlette Go modules PEP 517 pip
GitHub topics
#data-engineering #data-science #experiment-tracking #kubernetes #machine-learning #mlops
Updated
2026-09-09
Lists
1 list mention
First commit
2019-05-16
License
Apache-2.0
Issues
120 open
Sign in to like mlrun/mlrun
1,695
stars
Forks
318
Commits
7,948 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
kitops-ml/kitops

An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.

AI dev
Stack
Go Cobra React Tailwind CSS Vite Go modules pnpm
GitHub topics
#ai #code #datasets #devops #devops-tools #gguf
Updated
2026-09-07
Lists
1 list mention
First commit
2024-02-02
License
Apache-2.0
Issues
51 open
Sign in to like kitops-ml/kitops
1,412
stars
Forks
184
Commits
1,178 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub