Awesome Nlp

LLM inference in C/C++

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a high-performance serving framework for large language models and multimodal models.

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

State-of-the-Art Embeddings, Retrieval, and Reranking

Supercharge Your LLM Application Evaluations 🚀

A framework for few-shot evaluation of language models.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Large Language Model Text Generation Inference

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 48kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng Việt • TTS tiếng Việt

Doing simple retrieval from LLM models at various context lengths to measure accuracy

The Classical Language Toolkit

A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any other format