Skip to content

ulf-tokenizer version 1.3.10

Latest
Compare
Choose a tag to compare
@uhermjakob uhermjakob released this 24 Apr 04:56
· 8 commits to master since this release

Changes in version 1.3.10:

  • Handles Georgian text.
  • Normalizes non-standard spaces to ASCII space.