Search awesome repositories

LABR: Large Scale Arabic Book Reviews Dataset

spanlp: nlp applied for spanish vulgarity. A fast, robust Python library to check for profanity or offensive language in Spanish strings. It contains all the rude words of Spanish-speaking countries.

Contains demo codes for the course Applied Natural Language Processing

A collection of links to Ukrainian language tools

Thai Word Segmentation and Part-of-Speech Tagging with Deep Learning

청와대 국민청원 데이터

R package wrapping Mallet

No description.

Latxa: An Open Language Model and Evaluation Suite for Basque

ViText2SQL: A dataset for Vietnamese Text-to-SQL semantic parsing (EMNLP-2020 Findings)

Toolkit with state-of-the-art Automatic Terms Recognition methods in Scala

Indonesian Treebank

A high-accuracy, multilingual rule-based Sentence Boundary Detector (SBD) with a drop-in adapter for pysbd, delivering faster and more accurate sentence segmentation.

Platform for Evaluating and Reviewing of Multilingual Tasks

A character-wise tokenizer for morphologically rich languages

Alpino parser and related tools for Dutch

A variety of loaders for various NLP corpora.

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

Neural Network based models for Natural Language Processing

DRF-based API server for Shoonya platform

JavaScript Arabic Stemmer

NLP engine code

Java library to tokenize Thai text into a list of TCCs

Persian stemmer and morphological analyzer

Natural language toolkit for Indonesian Language (Bahasa)

An Indonesian word embedding demo

FoLiA library for C++

Tiny QA Benchmark++ a micro-benchmark suite (52-item gold + on-demand multilingual synthetic packs), generator CLI, and CI-ready eval harness for ultra-fast LLM smoke-testing & regression-catching.

Named Entity Recognition for Danish

An extensive Python library for dealing with FoLiA (Format for Linguistic Annotation) documents, a rich XML-based format for linguistic annotation finding application in Natural Language Processing (NLP). This library was formerly part of PyNLPl.