FloatAI / TKEval Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

[EMNLP'24(Findings)] Tokenization Falling Short

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md

Repository files navigation

EMNLP'24 Findings | Tokenization Falling Short: On Subword Robustness in Large Language Models

Datasets

Paper

EMNLP 2024

The official repository which contains the code and model checkpoints for our paper Tokenization Falling Short: On Subword Robustness in Large Language Models (Findings of EMNLP 2024).

🔥 News

21 September, 2024: 🎉 Our work has been accepted to EMNLP 2024 (Findings)! ⭐

Coming soon 🎠

About

[EMNLP'24(Findings)] Tokenization Falling Short

Custom properties

Report repository

Releases

No releases published

Packages

No packages published