Search awesome repositories

Persian NLP Toolkit

Korean BERT pre-trained cased (KoBERT)

A collection of links to Ruby Natural Language Processing (NLP) libraries, tools and software

Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

LongBench v2 and LongBench (ACL 25'&24')

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Text mining using tidy tools :sparkles::page_facing_up::sparkles:

Morphological analyzer / inflection engine for Russian and Ukrainian languages.

Thai natural language processing in Python

Natural language detection library for Rust. Try demo online: https://whatlang.org/

Data repository for pretrained NLP models and NLP corpora.

Expanding natural instructions

Self-contained Japanese Morphological Analyzer written in pure Go

Natural Language Interface for apps and devices

TruthfulQA: Measuring How Models Imitate Human Falsehoods

The Classical Language Toolkit

Portuguese pre-trained BERT models

Fast vectorization, topic modeling, distances and GloVe word embeddings in R.

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

The most accurate natural language detection library for Java and the JVM, suitable for long and short text alike

PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)

Kiwi(지능형 한국어 형태소 분석기)

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

PhoGPT: Generative Pre-training for Vietnamese (2023)

A Neural Framework for MT Evaluation

Facebook Low Resource (FLoRes) MT Benchmark

Natural Language Processing in Clojure (opennlp)

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

A Modern C++ Data Sciences Toolkit