Sign in
← All awesome lists Search these repos

Awesome List

Awesome Chatgpt

A curated list of awesome LLM frameworks, libraries and software.

uhub/awesome-llm #ai #awesome #awesome-list #curated-list #large-language-models #list #llm #resources unsupported Unicode escape sequence LINE 218: ...6-10-17 10:54:20.809694+00:00'::timestamptz, '', E'[{"path"... ^ DETAIL: \u0000 cannot be converted to text. CONTEXT: JSON data, line 1: ... "dependency_count": 24, "dependencies": ["\u0000...
Open GitHub
List stars
862
README repos
1,021
Indexed repos
1,666
List commits
617
Forks
101
Open issues
21

Tracked list growth

GitHub stars and default-branch commits for uhub/awesome-llm.

Latest scan 2026-10-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

12 repos matching these filters.

Topic: quantization
Latest repo push 2026-10-17

Filter this list

Search within Awesome Chatgpt or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

FareedKhan-dev/kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

Stack
C CMake uv
GitHub topics
#avx2 #c99 #cpu-inference #deep-learning #from-scratch #inference-engine
Updated
2026-10-02
Lists
1 list mention
First commit
2026-08-01
License
Apache-2.0
Issues
4 open
Sign in to like FareedKhan-dev/kimi-k3-in-c
9,076
stars
Forks
1,482
Commits
98 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
bitsandbytes-foundation/bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

AI dev
Stack
Python pytest CMake PEP 517 pip
GitHub topics
#llm #machine-learning #pytorch #qlora #quantization
Updated
2026-09-07
Lists
2 list mentions
First commit
2021-10-06
License
MIT
Issues
79 open
Sign in to like bitsandbytes-foundation/bitsandbytes
8,465
stars
Forks
923
Commits
1,220 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
vllm-project/llm-compressor

Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

AI dev
Stack
Python pytest PEP 517 pip
GitHub topics
#compression #quantization
Updated
2026-09-10
Lists
2 list mentions
First commit
2019-07-26
License
Apache-2.0
Issues
126 open
Sign in to like vllm-project/llm-compressor
3,770
stars
Forks
657
Commits
3,234 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
thu-ml/SageAttention

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

Stack
Cuda PEP 517 pip
GitHub topics
#attention #cuda #efficient-attention #inference-acceleration #llm #llm-infra
Updated
2026-01-17
Lists
1 list mention
First commit
2024-10-03
License
Apache-2.0
Issues
213 open
Sign in to like thu-ml/SageAttention
3,717
stars
Forks
504
Commits
188 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
amitshekhariitbhu/ai-engineering-interview-questions

Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

Stack
Markdown
GitHub topics
#agents #ai #ai-agents #ai-engineering #fine-tuning #interview
Updated
2026-10-14
Lists
1 list mention
First commit
2026-03-21
License
Apache-2.0
Issues
2 open
Sign in to like amitshekhariitbhu/ai-engineering-interview-questions
3,451
stars
Forks
622
Commits
157 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub
intel/neural-compressor

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

AI dev
Stack
Python pytest PEP 517 pip
GitHub topics
#auto-tuning #awq #fp4 #gptq #int4 #int8
Updated
2026-09-05
Lists
1 list mention
First commit
2020-06-16
License
Apache-2.0
Issues
25 open
Sign in to like intel/neural-compressor
2,707
stars
Forks
322
Commits
4,134 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
stochasticai/xTuring

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

Stack
Python FastAPI Gradio pytest React npm PEP 517 pip
GitHub topics
#adapter #deep-learning #fine-tuning #finetuning #gen-ai #generative-ai
Updated
2026-09-08
Lists
1 list mention
First commit
2023-03-19
License
Apache-2.0
Issues
5 open
Sign in to like stochasticai/xTuring
2,674
stars
Forks
210
Commits
692 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
adithya-s-k/AI-Engineering.academy

Mastering Applied AI, One Concept at a Time

Stack
Jupyter Notebook FastAPI LangChain LlamaIndex React npm pip
GitHub topics
#fine-tuning #finetuning #finetuning-llms #inference #large-language-models #llm
Updated
2026-02-27
Lists
1 list mention
First commit
2023-10-05
License
MIT
Issues
9 open
Sign in to like adithya-s-k/AI-Engineering.academy
2,383
stars
Forks
286
Commits
429 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Website GitHub