Implement the different methods of Learning Rate Decay and compare them
Link of the dataset : https://drive.google.com/file/d/19EVWjpMofMZJTd6dVyfDwysnBWrT9g4u/view?usp=sharing
This code contain following 4 cases:
- Constant Learning Rate
- Time based learning rate decay
- Step based learaning rate decay
- Exponential learning rate decay
The accuracy plots obtained in each case is given below :
- Constant Learning Rate
- Time based learning rate decay
- Step based learaning rate decay
- Exponential learning rate decay
