Awesome Nlp

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理

💫 Industrial-strength Natural Language Processing (NLP) in Python

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Oxford Deep NLP 2017 course

A very simple framework for state-of-the-art Natural Language Processing (NLP)

modest natural-language processing

An open-source NLP research library, built on PyTorch.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Large Language Model Text Generation Inference

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more

Language Technology Platform

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

State of the Art Natural Language Processing

Snips Python library to extract meaning from text

A Code-First Introduction to NLP course

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

:book: A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

Efficient few-shot learning with Sentence Transformers

NLP made easy

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

Beautiful visualizations of how language differs among document types.

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

NLP, before and after spaCy

Basic Utilities for PyTorch Natural Language Processing (NLP)

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L

Underthesea - AI Assistant

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.

Data and tools for generating and inspecting OLMo pre-training data.

Pre-trained ELMo Representations for Many Languages

Persian NLP Toolkit

Korean BERT pre-trained cased (KoBERT)

Natural language detection library for Rust. Try demo online: https://whatlang.org/

The Classical Language Toolkit

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

Kiwi(지능형 한국어 형태소 분석기)

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

A Neural Framework for MT Evaluation

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

A Modern C++ Data Sciences Toolkit

A Vietnamese natural language processing toolkit (NAACL 2018)

The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)

Accurately generate all possible forms of an English word e.g "election" --> "elect", "electoral", "electorate" etc.

NLP in Python with Deep Learning