Merge pull request #225 from davidycliao/dependabot/pip/tokenizers-0.…

…21.0 Bump tokenizers from 0.20.1 to 0.21.0
davidycliao · Dec 4, 2024 · b106707 · b106707
2 parents 4c6bb3a + 69965e9
commit b106707
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/requirements.txt b/requirements.txt
@@ -69,7 +69,7 @@ sympy==1.13.3
 tabulate==0.9.0
 threadpoolctl==3.2.0
 tifffile==2024.9.20
-tokenizers==0.20.1
+tokenizers==0.21.0
 torch==2.5.0
 torchvision==0.20.0
 tqdm==4.66.5