Awesome Nlp

No description.

🤗 ParsBERT: Transformer-based Model for Persian Language Understanding

Stopwords for 50 languages in JSON format

South-East Asia Large Language Models

UDPipe: Trainable pipeline for tokenizing, tagging, lemmatizing and parsing Universal Treebanks and other CoNLL-U files

Julia package for text analysis

List of resources and tools developed with focus on Portuguese.

Spanish word embeddings computed with different methods and from different corpora

Indonesian stemmer. Python port of PHP Sastrawi project.

Chatbot_data_for_Korean

A Python library for Interpretable Machine Learning in Text Classification using the SS3 model, with easy-to-use visualization tools for Explainable AI :octocat:

Snips NLU rust implementation

Largest list of Arabic stop words on Github. أكبر قائمة لمستبعدات الفهرسة العربية على جيت هاب

An NLP library for the Urdu language. It comes with a lot of battery included features to help you process Urdu data in the easiest way possible.

A comprehensive list of Hebrew NLP resources.

A collaborative project to collect datasets in Indonesian languages.

An R package for creating and exploring word2vec and other word embedding models

Python Vietnamese Core NLP Toolkit

No description.

R wrapper to spaCy NLP

A Language Processing Toolkit for Persian

Anafora is a web-based raw text annotation tool

The tool to make NLP datasets ready to use

پیکره بزرگ شناسایی موجودیت‌های نامدار فارسی برچسب خورده

No description.

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.

Rails-like inflection library for Clojure and ClojureScript

FastFit ⚡ When LLMs are Unfit Use FastFit ⚡ Fast and Effective Text Classification with Many Classes

State-of-the-Art Language Modeling and Text Classification in Hindi Language

A Vietnamese Text Processing Toolkit

Repository for research in the field of Responsible NLP at Meta.

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

Morfessor is a tool for unsupervised and semi-supervised morphological segmentation

Tools, wrappers, etc... for data science with a concentration on text processing

StereoSet: Measuring stereotypical bias in pretrained language models

Comprehensive NLP Evaluation System

초경량 한국어 형태소 분석기 — 1MB 모델로 브라우저에서 실행(WASM). Ultra-lightweight Korean morphological analyzer in the browser. npm: garu-ko

Sentiment Classification using Word Sense Disambiguation

A massively multilingual modern encoder language model

Persian Analyzer For Elasticsearch.

A Library to parse natural language in pure Clojure and ClojureScript

Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)

Thai Word-Segmentation with LSTM in Tensorflow

A fast and accurate POS and morphological tagging toolkit (EACL 2014)

Japanese Natural Langauge Processing Libraries

คลังศัพท์ภาษาไทย

:new: Demo code for the Natural Language Understanding Service.

This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models" (EMNLP 2020).

[EMNLP-2024] ⚓️ Sailor: Open Language Models for South-East Asia

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.