Binxu Wang (binxu_wang@hms.harvard.edu)
April. 17th, 2023
Transformer Jupyter Notebook Tutorial Series
- Fundamentals
- Understanding Attention & Transformer (no GPU required)
- Language modelling with transformer (CPU or GPU)
- Beyond Language
- All the following notebooks include training transformer, shall be run with GPU runtime or the training takes too long.
- Learn to do arithmetics by sequence modelling. (Simple, GPU Training ~ 10 min)
- Image generation by sequence modelling. (Simple, GPU Training ~ 10 ~ 20 min)
Audio signal classification (Medium, GPU Training ~ 20 min)(WARNING: currently, there is a dependency install error, don't run on Colab.)- Image classification (Medium, GPU Training ~ 30 min)
- Music generation by sequence modelling. (Difficult, GPU Training takes hrs)
- Large Language Model
- OpenAI API and Chat with PDF (Simple, no GPU needed, ~5mins)
