Tokenizer v0.2.5

meili-bot released this 18 Aug 11:34

· 693 commits to main since this release

Changes

change ZeroRemover into ControlCharacterRemover (#55) @ManyTheFish
Add a rustfmt config file into the project (#57) @Kerollmops

Thanks again to @Kerollmops, @ManyTheFish, and @curquiza! 🎉

Contributors

Kerollmops, ManyTheFish, and curquiza

Assets 2