Skip to content

Repository contains a python package for using segmentation methods built on top of (small) transformer language models.

License

Notifications You must be signed in to change notification settings

mideind/neural-tokenizers

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

neural-tokenizers

Repository contains a python package for using segmentation methods built on top of (small) transformer language models.

About

Repository contains a python package for using segmentation methods built on top of (small) transformer language models.

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •  

Languages