GitHub - grdscarabe/uima-word-tokenizer: A word tokenizer component for UIMA that take advantage of unicode general classes. The tokenizer only handles French for the moment, but can be extended quite easily.

grdscarabe / uima-word-tokenizer Public

Notifications You must be signed in to change notification settings
Fork 1
Star 7

A word tokenizer component for UIMA that take advantage of unicode general classes. The tokenizer only handles French for the moment, but can be extended quite easily.

www.fabienpoulard.info/?post/2010/09/06/un-rapide-tokeniseur-en-mots-pour-le-fran%c3%a7ais

Apache-2.0 license

7 stars 1 fork Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
desc/tddts/preprocessing/ae		desc/tddts/preprocessing/ae
src/java/main		src/java/main
test/tddts/preprocessing/tokenizer		test/tddts/preprocessing/tokenizer
LICENSE		LICENSE
README		README
pom.xml		pom.xml

Repository files navigation

See http://www.fabienpoulard.info/?post/2010/09/06/Un-rapide-tokeniseur-en-mots-pour-le-fran%C3%A7ais

About

A word tokenizer component for UIMA that take advantage of unicode general classes. The tokenizer only handles French for the moment, but can be extended quite easily.

www.fabienpoulard.info/?post/2010/09/06/Un-rapide-tokeniseur-en-mots-pour-le-fran%C3%A7ais

Readme

Apache-2.0 license

Activity

7 stars

2 watching

1 fork

Report repository