Awesome Nlp

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

A high-throughput and memory-efficient inference and serving engine for LLMs

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.

A very simple framework for state-of-the-art Natural Language Processing (NLP)

An open-source NLP research library, built on PyTorch.

Large Language Model Text Generation Inference

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Basic Utilities for PyTorch Natural Language Processing (NLP)

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Korean BERT pre-trained cased (KoBERT)

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

Comprehensive NLP Evaluation System

PyTorch implementation of the end-to-end coreference resolution model with different higher-order inference methods.