Awesome Nlp

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理

💫 Industrial-strength Natural Language Processing (NLP) in Python

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

Oxford Deep NLP 2017 course

A very simple framework for state-of-the-art Natural Language Processing (NLP)

Unsupervised text tokenizer for Neural Network-based text generation.

An open-source NLP research library, built on PyTorch.

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Open source annotation tool for machine learning practitioners.

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

Stanford NLP Python library for tokenization, sentence segmentation, NER, and parsing of many human languages

An NLP library for building bots, with entity extraction, sentiment analysis, automatic language identify, and so more

Language Technology Platform

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

State of the Art Natural Language Processing

A series of large language models developed by Baichuan Intelligent Technology

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

:book: A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.

MITIE: library and tools for information extraction

NLP made easy

Machine Learning University: Accelerated Natural Language Processing Class

Beautiful visualizations of how language differs among document types.

NLP, before and after spaCy

Basic Utilities for PyTorch Natural Language Processing (NLP)

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L

BERT score for text generation

Persian NLP Toolkit

Text mining using tidy tools :sparkles::page_facing_up::sparkles:

Thai natural language processing in Python

Portuguese pre-trained BERT models

Fast vectorization, topic modeling, distances and GloVe word embeddings in R.

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

A Neural Framework for MT Evaluation

A Vietnamese natural language processing toolkit (NAACL 2018)

Resources and tools for Indian language Natural Language Processing

Accurately generate all possible forms of an English word e.g "election" --> "elect", "electoral", "electorate" etc.

NLP in Python with Deep Learning

REBEL is a seq2seq model that simplifies Relation Extraction (EMNLP 2021).

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

A Python library for Interpretable Machine Learning in Text Classification using the SS3 model, with easy-to-use visualization tools for Explainable AI :octocat:

The tool to make NLP datasets ready to use

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

Comprehensive NLP Evaluation System

A Library to parse natural language in pure Clojure and ClojureScript

IndoLEM is a comprehensive Indonesian NLU benchmark, comprising three pillars NLP task: morpho-syntax, semantic, and discourse. Presented in COLING 2020.

Unannotated Spanish 3 Billion Words Corpora