Search awesome repositories

Repository for research in the field of Responsible NLP at Meta.

DaNLP is a repository for Natural Language Processing resources for the Danish Language.

Morfessor is a tool for unsupervised and semi-supervised morphological segmentation

Tools, wrappers, etc... for data science with a concentration on text processing

StereoSet: Measuring stereotypical bias in pretrained language models

Comprehensive NLP Evaluation System

초경량 한국어 형태소 분석기 — 1MB 모델로 브라우저에서 실행(WASM). Ultra-lightweight Korean morphological analyzer in the browser. npm: garu-ko

Sentiment Classification using Word Sense Disambiguation

A massively multilingual modern encoder language model

Persian Analyzer For Elasticsearch.

A Library to parse natural language in pure Clojure and ClojureScript

Neural network models for joint POS tagging and dependency parsing (CoNLL 2017-2018)

Thai Word-Segmentation with LSTM in Tensorflow

A fast and accurate POS and morphological tagging toolkit (EACL 2014)

Japanese Natural Langauge Processing Libraries

คลังศัพท์ภาษาไทย

:new: Demo code for the Natural Language Understanding Service.

This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models" (EMNLP 2020).

[EMNLP-2024] ⚓️ Sailor: Open Language Models for South-East Asia

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

OpenIE6 system

Pretraining, fine-tuning and evaluation scripts for IndicBERT-v2 and IndicXTREME

Pretraining transformer based Thai language models

State of the Art Language models and Classifier for Hindi language (spoken in Indian sub-continent)

Large Arabic Resources For Sentiment Analysis

A Go Lang package for dealing with Arabic text.

IndoLEM is a comprehensive Indonesian NLU benchmark, comprising three pillars NLP task: morpho-syntax, semantic, and discourse. Presented in COLING 2020.

FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. Flat allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm.

A collaborative project to collect datasets in SEA languages, SEA regions, or SEA cultures.

Unannotated Spanish 3 Billion Words Corpora