Awesome Chatgpt

Cybersecurity AI (CAI), the framework for AI Security

"AutoAgent: Fully-Automated and Zero-Code LLM Agent Framework"

High-speed Large Language Model Serving for Local Deployment

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

Automate your mobile devices with natural language commands - an LLM agnostic mobile Agent 🤖

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

the LLM vulnerability scanner

The programming language for agents

Easily fine-tune, evaluate and deploy Qwen, Gemma, or any open weight LLM!

Running large language models on a single GPU for throughput-oriented scenarios.

📡 Your own AI-powered news radar. Generates daily briefings in English & Chinese. | 用 AI 构建你专属的新闻雷达

Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge bases. It can effectively overcome the shortcomings of the traditional RAG vector similarity calculation model.

PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

TypeChat is a library that makes it easy to build natural language interfaces using types.

Build effective agents using Model Context Protocol and simple workflow patterns

An Autonomous LLM Agent for Complex Task Solving

Accessible large language models via k-bit quantization for PyTorch.

slime is an LLM post-training framework for RL Scaling.

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Build autonomous AI agents in Python.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

Repo to accompany my mastering LLM engineering course

A CLI tool to convert your codebase into a single LLM prompt with source tree, prompt templating, and token counting.

LLM-powered multiagent persona simulation for imagination enhancement and business insights.

Adding guardrails to large language models.

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

RikkaHub is an Android APP that supports for multiple LLM providers.

Tools for merging pretrained large language models.

AutoClip : AI-powered video clipping and highlight generation · 一款智能高光提取与剪辑的二创工具

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

The Enterprise-Grade Multi-Agent Orchestration Framework. Website: https://swarms.ai

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

Memory library for building stateful agents

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

OpenSquilla — Token-Efficient AI Agent with same budget, higher intelligence density