Skip to content

Tokenizer v0.2.4
Compare
Choose a tag to compare
@qdequele qdequele released this 22 Jul 14:37
· 701 commits to main since this release
v0.2.4
135d08d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Changes

  • Introduce a new default normalizer that removes zeroes from tokens (#52) @Kerollmops

Thanks again to @Kerollmops ! 🎉

Assets 2
Loading