Skip to content

Releases: meilisearch/charabia

Charabia v0.5.0

02 Jun 14:12
Compare
Choose a tag to compare

Changes

New Language support

  • Hebrew: Remove diacritics via a specialized Normalizer (#101) @benny-n
  • Japanese: Use Lindera as the specialized Segmenter for Japanese (#105) @loiclec

Chores

Breaking changes ⚠️

  • Fix a typo in a function name original_lenghts becomes original_lengths (#97) @ManyTheFish

Thanks again to @ManyTheFish, @benny-n, @gmourier, and @loiclec! 🎉

Charabia v0.4.0

05 May 09:11
Compare
Choose a tag to compare

Breaking changes ⚠️

  • Completely refactor the API in order to make it more contribuable and more practical to use
  • Rename repository to Charabia

Discover our newly created crates released in beta on crates.io!

Thanks again to @ManyTheFish, @Kerollmops, and @curquiza! 🎉

Tokenizer v0.2.9

17 Mar 10:50
Compare
Choose a tag to compare

Changes

Update lindera to 0.12.0

Thanks again to @ManyTheFish! 🎉

Tokenizer v0.2.8

14 Mar 15:55
afd1097
Compare
Choose a tag to compare

Changes

Thanks again to @Kerollmops, @ManyTheFish, @Thearas, @curquiza, @miiton and @mosuka! 🎉

Tokenizer v0.2.7

10 Jan 18:45
Compare
Choose a tag to compare

Changes

  • Count chars instead of graphemes and fix return value when char_map is uninitialized (#64) @Samyak2

Thanks again to @Samyak2 ! 🎉

Tokenizer v0.2.6

10 Nov 14:02
a69bb0c
Compare
Choose a tag to compare

Changes

Thanks again to @ManyTheFish, @Samyak2, @datamaker and JB! 🎉

Tokenizer v0.2.5

18 Aug 11:34
c0b5cf7
Compare
Choose a tag to compare

Changes

Thanks again to @Kerollmops, @ManyTheFish, and @curquiza! 🎉

Tokenizer v0.2.4

22 Jul 14:37
135d08d
Compare
Choose a tag to compare

Changes

  • Introduce a new default normalizer that removes zeroes from tokens (#52) @Kerollmops

Thanks again to @Kerollmops ! 🎉

Tokenizer v0.2.3

10 Jun 14:59
c2399c3
Compare
Choose a tag to compare

Changes

Thanks again to @ManyTheFish! 🎉

Tokenizer v0.2.2

03 May 08:53
eda4ed4
Compare
Choose a tag to compare

Changes

Thanks again to @LegendreM, and @shekhirin! 🎉