recover from `transformers 4.34 refactored`#155

Draft

victorlee0505 wants to merge 2 commits intomarella:mainfrom

victorlee0505:vlee/transformers

Commits on Oct 4, 2023

recover `transformers 4.34 refactored`
victorlee0505
committed

Commits on Oct 6, 2023

implement def get_vocab(self) from transformers
victorlee0505
committed