Awesome Nlp

A suite of Arabic natural language processing tools developed by the CAMeL Lab at New York University Abu Dhabi.

REBEL is a seq2seq model that simplifies Relation Extraction (EMNLP 2021).

The hands-on NLTK tutorial for NLP in Python

Deliver safe & effective language models

A web-based annotation tool for natural language processing (NLP)

BETO - Spanish version of the BERT model

CogComp's Natural Language Processing Libraries and Demos: Modules include lemmatizer, ner, pos, prep-srl, quantifier, question type, relation-extraction, similarity, temporal normalizer, tokenizer, transliteration, verb-sense, and more.

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

KSS: Korean String processing Suite

Fast and production-ready question answering in Node.js

potato: the portable annotation tool

🤗 ParsBERT: Transformer-based Model for Persian Language Understanding

List of resources and tools developed with focus on Portuguese.

Spanish word embeddings computed with different methods and from different corpora

A Python library for Interpretable Machine Learning in Text Classification using the SS3 model, with easy-to-use visualization tools for Explainable AI :octocat:

R wrapper to spaCy NLP

پیکره بزرگ شناسایی موجودیت‌های نامدار فارسی برچسب خورده

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

Comprehensive NLP Evaluation System

초경량 한국어 형태소 분석기 — 1MB 모델로 브라우저에서 실행(WASM). Ultra-lightweight Korean morphological analyzer in the browser. npm: garu-ko

A fast and accurate POS and morphological tagging toolkit (EACL 2014)

Japanese Natural Langauge Processing Libraries

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. Flat allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm.

Unannotated Spanish 3 Billion Words Corpora

High performance tokenizers for natural language processing and other related tasks

Frog is an integration of memory-based natural language processing (NLP) modules developed for Dutch. All NLP modules are based on Timbl, the Tilburg memory-based learning software package.

A keyphrase extractor for Persian

Collection of Urdu datasets for POS, NER, Sentiment, Summarization and NLP tasks.

Unicode tokeniser. Ucto tokenizes text files: it separates words from punctuation, and splits sentences. It offers several other basic preprocessing steps such as changing case that you can all use to make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation. Ucto comes with tokenisation rules for several languages and can be easily extended to suit other languages. It has been incorporated for tokenizing Dutch text in Frog, our Dutch morpho-syntactic processor. http://ilk.uvt.nl/ucto --

A Domain Specific Language (DSL) for building language patterns. These can be later compiled into spaCy patterns, pure regex, or any other format

InsNet Runs Instance-dependent Neural Networks with Padding-free Dynamic Batching.

Code and models for "The Interplay of Variant, Size, and Task Type in Arabic Pre-trained Language Models". EACL 2021, WANLP.

PyTorch implementation of the end-to-end coreference resolution model with different higher-order inference methods.

spanlp: nlp applied for spanish vulgarity. A fast, robust Python library to check for profanity or offensive language in Spanish strings. It contains all the rude words of Spanish-speaking countries.

A collection of links to Ukrainian language tools

A high-accuracy, multilingual rule-based Sentence Boundary Detector (SBD) with a drop-in adapter for pysbd, delivering faster and more accurate sentence segmentation.

A variety of loaders for various NLP corpora.

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

NLP engine code

Natural language toolkit for Indonesian Language (Bahasa)

An Indonesian word embedding demo

FoLiA library for C++

An extensive Python library for dealing with FoLiA (Format for Linguistic Annotation) documents, a rich XML-based format for linguistic annotation finding application in Natural Language Processing (NLP). This library was formerly part of PyNLPl.

Spanish Word Embeddings computed from large corpora and different sizes using fastText.

Go library: convert numbers to Russian words with correct grammar. Числа прописью на Go с правильными склонениями.

Spanish Sentence Embeddings computed from large corpora using sent2vec.

Bilingual RAG evaluation benchmark for culturally grounded English/Uzbek retrieval