Search awesome repositories

Building a quick conversation-based search demo with Lepton AI.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Fast, flexible LLM inference

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Efficient Triton Kernels for LLM Training

非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型， 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜，也提供规模超200万的大模型缺陷库！方便广大社区研究分析、改进大模型。

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

A PyTorch native platform for training generative AI models

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

AutoRAG: Now your agent can find anything in your computer. It gets smarter if you are using it frequently.

A blazing fast inference solution for text embeddings models

🌟100+ 原创 LLM / RL 原理图📚，《大模型算法》作者巨献！💥（100+ LLM/RL Algorithm Maps ）

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

No description.

AdalFlow: The library to build & auto-optimize LLM applications.

Harness LLMs with Multi-Agent Programming

Easiest and laziest way for building multi-agent LLMs applications.

The platform for LLM evaluations and AI agent testing

A quick guide (especially) for trending instruction finetuning datasets

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali

The hub for EleutherAI's work on interpretability and learning dynamics

[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.

Minimalistic large language model 3D-parallelism training