Skip to content

Latest commit

 

History

History
2 lines (2 loc) · 319 Bytes

README.md

File metadata and controls

2 lines (2 loc) · 319 Bytes

ScratchFormer

The concept of Transformers has always escaped my grasped and it's one I constantly have to come back to read up on. I've decided to take a page out of Feynmann's playbook and create what I am seemingly unable to understand. This is my attempt at creating a working Transformer from scratch in PyTorch.