Pytorch_Personal_Study

For Improving Pytorch Coding Ability

1. Pytorch Grammer

2. Knowledge Distillation implementation

Output based KD - Soft label method

Feature based KD - Cosine Embedding Loss

Feature based KD - Intermediate Regressor Method

3. CNN model implementation