from-scratch

This project is complete and is currently archived.

As the name suggests, everything from scratch.

An extension of my other side project, picograd. But here I will be a little more extensive.

MLP visualization is under assets/

These examples in the notebook can be played around with according to your choice. Right now, my plans are to build:

1. RNN and LSTM [COMPLETE]
2. More optimizers [COMPLETE]
3. Multi-Head Attention [COMPLETE]