Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.
UFO³: Weaving the Digital Agent Galaxy
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
World's first open-source enterprise world model.
🐸 Read Frog - Language Learning & Translate | 🐸 陪读蛙 - 语言学习与翻译
The programming language for agents
📡 Your own AI-powered news radar. Generates daily briefings in English & Chinese. | 用 AI 构建你专属的新闻雷达
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
智能闲鱼客服机器人系统:专为闲鱼平台打造的AI值守解决方案,实现闲鱼平台7×24小时自动化值守,支持多专家协同决策、智能议价和上下文感知对话。
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.
⚙️🦀 Build modular and scalable LLM Applications in Rust
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
vits2 backbone with multilingual-bert
An open-source, code-first Go toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
The Open Standard for Generative UI
TypeChat is a library that makes it easy to build natural language interfaces using types.
My Python scripts to make high-quality figures for publications in top AI conferences and journals.
Build effective agents using Model Context Protocol and simple workflow patterns
Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
Accessible large language models via k-bit quantization for PyTorch.
Put an end to code hallucinations! GitMCP is a free, open-source, remote MCP server for any GitHub project
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
A collection of libraries to optimise AI model performances
Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et al.
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Building a quick conversation-based search demo with Lepton AI.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
22 prompt engineering techniques with hands-on Jupyter Notebook tutorials, from fundamental concepts to advanced strategies for leveraging LLMs.
Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
Fast, flexible LLM inference
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
🔥 Open Source Browser API for AI Agents & Apps. Steel Browser is a batteries-included browser sandbox that lets you automate the web without worrying about infrastructure.
The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent
Adding guardrails to large language models.
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.
File Parser optimised for LLM Ingestion with no loss 🧠 Parse PDFs, Docx, PPTx in a format that is ideal for LLMs.
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.
An AI-powered next-generation open source real-time observability system.
Tools for merging pretrained large language models.
每个人都能看懂的大模型知识分享,LLMs春/秋招大模型面试前必看,让你和面试官侃侃而谈
Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).
The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first.