Sign in
← All awesome lists Search these repos

Awesome List

Awesome Chatgpt

A curated list of awesome LLM frameworks, libraries and software.

uhub/awesome-llm #ai #awesome #awesome-list #curated-list #large-language-models #list #llm #resources unsupported Unicode escape sequence LINE 218: ...6-10-17 10:54:20.809694+00:00'::timestamptz, '', E'[{"path"... ^ DETAIL: \u0000 cannot be converted to text. CONTEXT: JSON data, line 1: ... "dependency_count": 24, "dependencies": ["\u0000...
Open GitHub
List stars
862
README repos
1,021
Indexed repos
1,666
List commits
617
Forks
101
Open issues
21

Tracked list growth

GitHub stars and default-branch commits for uhub/awesome-llm.

Latest scan 2026-10-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

8 repos matching these filters.

Topic: model-serving
Latest repo push 2026-10-17

Filter this list

Search within Awesome Chatgpt or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

AI dev
Stack
Python Axum FastAPI pytest Starlette Cargo CMake PEP 517
GitHub topics
#amd #blackwell #cuda #deepseek #deepseek-v3 #gpt
Updated
2026-10-09
Lists
4 list mentions
First commit
2023-02-09
License
Apache-2.0
Issues
8,640 open
Sign in to like vllm-project/vllm
93,418
stars
Forks
23,151
Commits
22,725 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Stack
Python FastAPI pytest Starlette Tornado PDM pip uv
GitHub topics
#ai-inference #deep-learning #generative-ai #inference-platform #llm #llm-inference
Updated
2026-08-28
Lists
2 list mentions
First commit
2019-04-02
License
Apache-2.0
Issues
218 open
Sign in to like bentoml/BentoML
8,822
stars
Forks
1,024
Commits
3,761 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
HuaizhengZhang/AI-Infra-from-Zero-to-Hero

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑‍💻 Video Tutorials.

GitHub topics
#ai-infra #genai #large-language-models #llmsys #mlsys #model-serving
Updated
2025-07-25
Lists
1 list mention
First commit
2019-01-07
License
MIT
Issues
14 open
Sign in to like HuaizhengZhang/AI-Infra-from-Zero-to-Hero
4,338
stars
Forks
410
Commits
513 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
ModelTC/LightLLM

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Stack
Python FastAPI pip
GitHub topics
#deep-learning #gpt #llama #llm #model-serving #nlp
Updated
2026-09-10
Lists
2 list mentions
First commit
2023-07-22
License
Apache-2.0
Issues
159 open
Sign in to like ModelTC/LightLLM
4,276
stars
Forks
362
Commits
977 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
GitHub
thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

Stack
Python pip
GitHub topics
#deepseek #gpu #llm #llm-serving #model-serving #pytorch
Updated
2026-09-09
Lists
1 list mention
First commit
2025-03-13
License
Apache-2.0
Issues
57 open
Sign in to like thu-pacman/chitu
3,000
stars
Forks
258
Commits
1,603 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
openlake-project/openlake

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

AI dev
Stack
Rust Axum Next.js React Tailwind CSS Cargo CMake npm
GitHub topics
#blackwell #gpt #gpu #high-performance #llm #llm-training
Updated
2026-09-06
Lists
1 list mention
First commit
2026-05-06
License
Apache-2.0
Issues
136 open
Sign in to like openlake-project/openlake
2,487
stars
Forks
424
Commits
202 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub