Awesome Chatgpt

OpenSquilla — Token-Efficient AI Agent with same budget, higher intelligence density

Postgres with GPUs for ML/AI apps.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Efficient Triton Kernels for LLM Training

Julep — durable, composable AI agents. Flows that crash and resume, retry safely, and explain every step.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

FlashInfer: Kernel Library for LLM Serving

Towards Human-Sounding Speech

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

an ambient intelligence library

The first "code-first" agent framework for seamlessly planning and executing data analytics tasks.

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

Nexent is a zero-code platform for auto-generating production-grade AI agents using Harness Engineering principles — unified tools, skills, memory, and orchestration with built-in constraints, feedback loops, and control planes.

The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.

Democratizing Reinforcement Learning for LLMs

Chronos: Pretrained Models for Time Series Forecasting

🐢 Open-Source Evaluation & Testing library for LLM Agents

Klavis AI: MCP integration platforms that let AI agents use tools reliably at any scale

A visual playground for agentic workflows: Iterate over your agents 10x faster

Gemma open-weight LLM library, from Google DeepMind

A programmable Mixture-of-Models router for heterogeneous LLM inference

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Autonomous Hacking Agent for Red Team

Agent-ready RPA suite with out-of-the-box automation tools. Built for individuals and enterprises.

Autonomous Hacking Agent for Red Team

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

🚀 2026 最系统的 AI Agent 速成指南｜智能体实战教程 · 完整学习路径 + 实战项目 + 面试题库 · 对标大模型应用开发工程师岗位 · 覆盖LangChain / LangGraph / Coze / Dify / MCP / skills / LLM / RAG / 提示词 · 企业级部署与微调 · 从0到企业级落地 + 从学习到上线项目 + 面试准备一体化

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

OpenClaw: Use All Major AI Models NO API Token! Claude/ChatGPT/Gemini/DeepSeek/Doubao/Grok/Qwen/Manus/Kimi

A Next-Generation Training Engine Built for Ultra-Large MoE Models

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Magicrew. The first open-source all-in-one AI productivity platform (Generalist AI Agent + Workflow Engine + IM + Online collaborative office system)

A blazing fast inference solution for text embeddings models

Where data access meets operational intelligence

Ecommerce Search and Discovery - marqo.ai

A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.

An Agentic Framework for Reflective PowerPoint Generation

Zep | Examples, Integrations, & More

Prompt Orchestration Markup Language

Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

Agenta is a workspace where you and your team build agents and automations.

《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！