natural-language-processing.md

Bookmarks tagged [natural-language-processing]

^{www.codever.land/bookmarks/t/natural-language-processing}

getlang

^{https://github.com/rylans/getlang}

Fast natural language detection package.

• tags: go, natural-language-processing, nlp
• source code

---

go-eco

^{https://github.com/ThePaw/go-eco}

Similarity, dissimilarity and distance matrices; diversity, equitability and inequality measures; species richness estimators; coenocline models.

• tags: go, natural-language-processing, nlp
• source code

---

go-i18n

^{https://github.com/nicksnyder/go-i18n/}

Package and an accompanying tool to work with localized text.

• tags: go, natural-language-processing, nlp
• source code

---

go-mystem

^{https://github.com/dveselov/mystem}

CGo bindings to Yandex.Mystem - russian morphology analyzer.

• tags: go, natural-language-processing, nlp
• source code

---

go-nlp

^{https://github.com/nuance/go-nlp}

Utilities for working with discrete probability distributions and other tools useful for doing NLP work.

• tags: go, natural-language-processing, nlp
• source code

---

go-pinyin

^{https://github.com/mozillazg/go-pinyin}

CN Hanzi to Hanyu Pinyin converter.

• tags: go, natural-language-processing, nlp
• source code

---

go-stem

^{https://github.com/agonopol/go-stem}

Implementation of the porter stemming algorithm.

• tags: go, natural-language-processing, nlp
• source code

---

go-unidecode

^{https://github.com/mozillazg/go-unidecode}

ASCII transliterations of Unicode text.

• tags: go, natural-language-processing, nlp
• source code

---

go2vec

^{https://github.com/danieldk/go2vec}

Reader and utility functions for word2vec embeddings.

• tags: go, natural-language-processing, nlp
• source code

---

gojieba

^{https://github.com/yanyiwu/gojieba}

This is a Go implementation of jieba which a Chinese word splitting algorithm.

• tags: go, natural-language-processing, nlp
• source code

---

golibstemmer

^{https://github.com/rjohnsondev/golibstemmer}

Go bindings for the snowball libstemmer library including porter 2.

• tags: go, natural-language-processing, nlp
• source code

---

gotokenizer

^{https://github.com/xujiajun/gotokenizer}

A tokenizer based on the dictionary and Bigram language models for Golang. (Now only support chinese segmentation)

• tags: go, natural-language-processing, nlp
• source code

---

gounidecode

^{https://github.com/fiam/gounidecode}

Unicode transliterator (also known as unidecode) for Go.

• tags: go, natural-language-processing, nlp
• source code

---

gse

^{https://github.com/go-ego/gse}

Go efficient text segmentation; support english, chinese, japanese and other.

• tags: go, natural-language-processing, nlp
• source code

---

icu

^{https://github.com/goodsign/icu}

Cgo binding for icu4c C library detection and conversion functions. Guaranteed compatibility with version 50.1.

• tags: go, natural-language-processing, nlp
• source code

---

kagome

^{https://github.com/ikawaha/kagome}

JP morphological analyzer written in pure Go.

• tags: go, natural-language-processing, nlp
• source code

---

libtextcat

^{https://github.com/goodsign/libtextcat}

Cgo binding for libtextcat C library. Guaranteed compatibility with version 2.2.

• tags: go, natural-language-processing, nlp
• source code

---

MMSEGO

^{https://github.com/awsong/MMSEGO}

This is a GO implementation of MMSEG which a Chinese word splitting algorithm.

• tags: go, natural-language-processing, nlp
• source code

---

nlp

^{https://github.com/Shixzie/nlp}

Extract values from strings and fill your structs with nlp.

• tags: go, natural-language-processing, nlp
• source code

---

nlp

^{https://github.com/james-bowman/nlp}

Go Natural Language Processing library supporting LSA (Latent Semantic Analysis).

• tags: go, natural-language-processing, nlp
• source code

---

paicehusk

^{https://github.com/rookii/paicehusk}

Golang implementation of the Paice/Husk Stemming Algorithm.

• tags: go, natural-language-processing, nlp
• source code

---

petrovich

^{https://github.com/striker2000/petrovich}

Petrovich is the library which inflects Russian names to given grammatical case.

• tags: go, natural-language-processing, nlp
• source code

---

porter

^{https://github.com/a2800276/porter}

This is a fairly straightforward port of Martin Porter's C implementation of the Porter stemming algorithm.

• tags: go, natural-language-processing, nlp
• source code

---

porter2

^{https://github.com/zhenjl/porter2}

Really fast Porter 2 stemmer.

• tags: go, natural-language-processing, nlp
• source code

---

prose

^{https://github.com/jdkato/prose}

Library for text processing that supports tokenization, part-of-speech tagging, named-entity extraction, and more.

• tags: go, natural-language-processing, nlp
• source code

---

RAKE.go

^{https://github.com/Obaied/RAKE.go}

Go port of the Rapid Automatic Keyword Extraction Algorithm (RAKE).

• tags: go, natural-language-processing, nlp
• source code

---

segment

^{https://github.com/blevesearch/segment}

Go library for performing Unicode Text Segmentation as described in Unicode Standard Annex 29

• tags: go, natural-language-processing, nlp
• source code

---

sentences

^{https://github.com/neurosnap/sentences}

Sentence tokenizer: converts text into a list of sentences.

• tags: go, natural-language-processing, nlp
• source code

---

shamoji

^{https://github.com/osamingo/shamoji}

The shamoji is word filtering package written in Go.

• tags: go, natural-language-processing, nlp
• source code

---

snowball

^{https://github.com/goodsign/snowball}

Snowball stemmer port (cgo wrapper) for Go. Provides word stem extraction functionality Snowball native.

• tags: go, natural-language-processing, nlp
• source code

---

stemmer

^{https://github.com/dchest/stemmer}

Stemmer packages for Go programming language. Includes English and German stemmers.

• tags: go, natural-language-processing, nlp
• source code

---

textcat

^{https://github.com/pebbe/textcat}

Go package for n-gram based text categorization, with support for utf-8 and raw text.

• tags: go, natural-language-processing, nlp
• source code

---

whatlanggo

^{https://github.com/abadojack/whatlanggo}

Natural language detection package for Go. Supports 84 languages and 24 scripts (writing systems e.g. Latin, Cyrillic, etc).

• tags: go, natural-language-processing, nlp
• source code

---

when

^{https://github.com/olebedev/when}

Natural EN and RU language date/time parser with pluggable rules.

• tags: go, natural-language-processing, nlp
• source code

---

Awesome NLP with Ruby

^{https://github.com/arbox/nlp-with-ruby}

Awesome List for Practical Natural Language Processing done in Ruby.

• tags: ruby, natural-language-processing
• source code

---

Parslet

^{http://kschiess.github.io/parslet/}

A small Ruby library for constructing parsers in the PEG (Parsing Expression Grammar) fashion.

• tags: ruby, natural-language-processing

---

pocketsphinx-ruby

^{https://github.com/watsonbox/pocketsphinx-ruby}

Ruby speech recognition with Pocketsphinx.

• tags: ruby, natural-language-processing
• source code

---

Pragmatic Segmenter

^{https://github.com/diasks2/pragmatic_segmenter}

Pragmatic Segmenter is a rule-based sentence boundary detection gem that works out-of-the-box across many languages.

• tags: ruby, natural-language-processing
• source code

---

Ruby Natural Language Processing Resources

^{https://github.com/diasks2/ruby-nlp}

Collection of links to Ruby Natural Language Processing (NLP) libraries, tools and software.

• tags: ruby, natural-language-processing
• source code

---

Text

^{https://github.com/threedaymonk/text}

A collection of text algorithms including Levenshtein distance, Metaphone, Soundex 2, Porter stemming & White similarity.

• tags: ruby, natural-language-processing
• source code

---

Treat

^{https://github.com/louismullie/treat}

Treat is a toolkit for natural language processing and computational linguistics in Ruby.

• tags: ruby, natural-language-processing
• source code

---

Treetop

^{https://github.com/cjheath/treetop}

PEG (Parsing Expression Grammar) parser.

• tags: ruby, natural-language-processing
• source code

---

Words Counted

^{https://github.com/abitdodgy/words_counted}

A highly customisable Ruby text analyser and word counter.

• tags: ruby, natural-language-processing
• source code

---

gensim

^{https://github.com/RaRe-Technologies/gensim}

Topic Modelling for Humans.

• tags: python, natural-language-processing
• source code

---

langid.py

^{https://github.com/saffsd/langid.py}

Stand-alone language identification system.

• tags: python, natural-language-processing
• source code

---

nltk

^{http://www.nltk.org/}

A leading platform for building Python programs to work with human language data.

• tags: python, natural-language-processing

---

pattern

^{https://github.com/clips/pattern}

A web mining module for the Python.

• tags: python, natural-language-processing
• source code

---

polyglot

^{https://github.com/aboSamoor/polyglot}

Natural language pipeline supporting hundreds of languages.

• tags: python, natural-language-processing
• source code

---

pytext

^{https://github.com/facebookresearch/pytext}

A natural language modeling framework based on PyTorch.

• tags: python, natural-language-processing
• source code

---

PyTorch-NLP

^{https://github.com/PetrochukM/PyTorch-NLP}

A toolkit enabling rapid deep learning NLP prototyping for research.

• tags: python, natural-language-processing
• source code

---

spacy

^{https://spacy.io/}

A library for industrial-strength natural language processing in Python and Cython.

• tags: python, natural-language-processing

---

stanfordnlp

^{https://github.com/stanfordnlp/stanfordnlp}

The Stanford NLP Group's official Python library, supporting 50+ languages.

• tags: python, natural-language-processing
• source code

---

jieba

^{https://github.com/fxsjy/jieba}

The most popular Chinese text segmentation library.

• tags: python, natural-language-processing
• source code

---

pkuseg-python

^{https://github.com/lancopku/pkuseg-python}

A toolkit for Chinese word segmentation in various domains.

• tags: python, natural-language-processing
• source code

---

snownlp

^{https://github.com/isnowfy/snownlp}

A library for processing Chinese text.

• tags: python, natural-language-processing
• source code

---

funNLP

^{https://github.com/fighting41love/funNLP}

A collection of tools and datasets for Chinese NLP.

• tags: python, natural-language-processing
• source code

---

retext

^{https://github.com/wooorm/retext}

An extensible natural language system.

• tags: node.js, nlp, natural-language-processing
• source code

---

franc

^{https://github.com/wooorm/franc}

Detect the language of text.

• tags: node.js, nlp, natural-language-processing
• source code

---

leven

^{https://github.com/sindresorhus/leven}

Measure the difference between two strings using the Levenshtein distance algorithm.

• tags: node.js, nlp, natural-language-processing
• source code

---

natural

^{https://github.com/NaturalNode/natural}

Natural language facility.

• tags: node.js, nlp, natural-language-processing
• source code

---