Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome LLM frameworks, libraries and software.
GitHub stars and default-branch commits for uhub/awesome-llm.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM
❄️ ChatGPT Desktop Application (Mac, Windows and Linux)
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
The fastest, cheapest, most efficient open-source agent harness. Run more than 500 agents on a $10 VPS.
Hundreds of models & providers. One command to find what runs on your hardware.
Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (Meetly Ai - https://meetily.ai) is the #1 Self-hosted, Open-source Ai meeting note taker for macOS & Windows. Understand How to write meeting minutes
YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context
High performance coding agent harness written in rust
Open-source Agent Operating System
Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval and long-term memory.
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
Incremental engine for long horizon agents 🌟 Star if you like it!
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
A super fast Graph Database uses GraphBLAS under the hood for its sparse adjacency matrix graph representation. Our goal is to provide the best Knowledge Graph for LLM (GraphRAG).
Astrid is a portable, capability-secure operating system for composable software.
World's first open-source enterprise world model.
The programming language for agents
⚙️🦀 Build modular and scalable LLM Applications in Rust
Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code
Fast, flexible LLM inference
AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Postgres with GPUs for ML/AI apps.
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
A blazing fast inference solution for text embeddings models
Give agents an operating system as a library. Runs in your existing backend – no sandboxes, VMs, or SaaS. Powered by WebAssembly & V8 isolates.
Vision infrastructure to turn complex documents into RAG/LLM-ready data
NoFWL Desktop Application
Language model tokenization at GB/s
LeanCTX — Context Gateway for AI Systems. Control what your AI can see. Open-source Engine for context selection, supported controls, and evidence.
Multi-agent AI orchestration platform for automation, workflows, and developer tools. Golutra transforms Codex, Claude Code, and OpenClaw into a unified agent system with parallel execution, task orchestration, long-running workflows, and AI productivity workspace.
Hold a key, speak, release — AI-polished text appears at your cursor in any app. Open-source voice input for macOS & Windows. (按住快捷键说话,松开即得润色后的文字)
Manage multiple Claude Code, OpenCode agents from either TUI or Web for easy access on mobile. Also supports Mistral Vibe, Codex CLI, Gemini CLI, Pi.dev, Copilot CLI, Factory Droid Coding.
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
Manage ChatGPT, Codex CLI, and Claude Code accounts and track quota in one place. Use multi-model smart routing with priority and automatic failover. Install AI tools and deploy local LLMs in one click.
Deobfuscate Javascript code using ChatGPT
LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
An transformer based LLM. Written completely in Rust
A tiny, fast Rust CLI that drives a real browser over the Chrome DevTools Protocol — built for coding agents.
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
Fetch source code for npm packages to give AI coding agents deeper context
Beautiful git diff viewer, generate commits with AI, get summary of changes, all from the CLI
A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on your hardware.
All-in-one platform for search, recommendations, RAG, and analytics offered via API
Get web data for AI agents and LLMs - fast, efficient, and reliable with Rust
OpenLake is a high performance storage engine for efficient LLM inference and GPU Training
A fast Rust based tool to serialize text-based files in a repository or directory for LLM consumption