The BytePairTokenizer class is extremely, extremely slow at tokenizing #1095
chenying99Annotations
1 warning
|
welcome
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|