This ViT implemetnation was based on teh tutorials by mdbourke paper replicating. You can find it under scripts/ViT_mrdbourke.ipynb.

The Python scripts in this directory were generated using the notebook 05. Going Modular Part 2 (script mode).

They breakdown as follows:

• data_setup.py - a file to prepare and download data if needed.
• engine.py - a file containing various training functions.
• model_builder.py - a file to create a PyTorch TinyVGG model.
• train.py - a file to leverage all other files and train a target PyTorch model.
• utils.py - a file dedicated to helpful utility functions.
• Extra: predictions.py - a file for making predictions with a trained PyTorch model and input image (the main function, pred_and_plot_image() was originally created in 06. PyTorch Transfer Learning section 6).

For an explanation of how this was done, refer to section 05. PyTorch Going Modular of the learnpytorch.io book.