Awesome Chatgpt

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

An open-source visual programming environment for battle-testing prompts to LLMs.

Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.

A python program that turns an LLM, running on Ollama, into an automated researcher, which will with a single query determine focus areas to investigate, do websearches and scrape content from various relevant websites and do research for you all on its own! And more, not limited to but including saving the findings for you!

A minimal yet professional single agent demo project that showcases the core execution pipeline and production-grade features of agents.

Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs

High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

README file generator, powered by AI.

中文翻译的 Hands-On-Large-Language-Models (hands-on-llms)，动手学习大模型

Advanced CLI tool that scans your hardware and tells you exactly which LLM or sLLM models you can run locally, with full Ollama integration.

⚡LLM Zoo is a project that provides data, models, and evaluation benchmark for large language models.⚡

A 13B large language model developed by Baichuan Intelligent Technology

A agent framework based on the tutorial hello-agents

Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

LLMs-from-scratch项目中文翻译

OpenLIT is the open-source agent harness engineering platform: trace, evaluate, guard, and improve everything around the model in your AI agents, on OTEL.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

LLMRouter: An Open-Source Library for LLM Routing

🧠 AI-powered enterprise search engine 🔎

Community maintained hardware plugin for vLLM on Ascend

An Open-source Toolkit for LLM Development

YAYI 2 是中科闻歌研发的新一代开源大语言模型，采用了超过 2 万亿 Tokens 的高质量、多语言语料进行预训练。(Repo for YaYi 2 Chinese LLMs)

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient methods (e.g., lora, p-tuning) together for easy use. We welcome open-source enthusiasts to initiate any meaningful PR on this repo and integrate as many LLM related technologies as possible. 我们打造了方便研究人员上手和使用大模型等微调平台，我们欢迎开源爱好者发起任何有意义的pr！

Plugin for JADX to integrate MCP server

基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

Zero shot vulnerability discovery using LLMs

Control Any Computer Using LLMs.

机器学习、深度学习的学习路径及知识总结

All-in-one platform for search, recommendations, RAG, and analytics offered via API

SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

Let Skills Evolve Collectively with Agentic Evolver

[ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

Project Page for "LISA: Reasoning Segmentation via Large Language Model"

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

Database system for AI-powered apps

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

[EMNLP-2024] Build multimodal language agents for fast prototype and production

Build, run and scale AI agents like API and microservices

🧠 Make your agents learn from experience. Now available as a hosted solution at kayba.ai

Vibe-Research: Your Personal Trading Research Agent · A股/美股/港股 的个人投研 Agent：每日复盘、资讯雷达、个股数据、板块中心、我的持仓、研究记录、回测。Vibe-Research 把数据和功能配齐，由你自己的 Agent 驱动投资研究。基于开源的 Codex Harness 打造。

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

🎙️ A 0.1B Omni model trained from scratch, capable of listening, speaking, and seeing!

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

Official Code of Memento: Fine-tuning LLM Agents without Fine-tuning LLMs

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

A benchmark for LLMs on complicated tasks in the terminal

AudioMuse-AI uses sonic analysis to rediscover forgotten songs, uncover hidden connections in your music library, and generate intelligent playlists for Navidrome, Jellyfin, LMS, Lyrion, Emby and Plex: no metadata or external services required.

动手学Ollama，CPU玩转大模型部署，在线阅读地址：https://datawhalechina.github.io/handy-ollama/

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends