Skip to content

Officium/Capsules

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

Capsules

CapsNet implementations with PyTorch. Randomness in codes is removed.

Requirements

Python 3.5
PyTorch 0.4.1

Dynamic Routing Between Capsules

Sabour S, Frosst N, Hinton G E. Dynamic routing between capsules[C]//Advances in neural information processing systems. 2017: 3856-3866.
With the best hyperparameters on MNIST dataset in the paper, training will takes 5 hours with two GTX 1070.

Best Test Accuracy
Paper 99.75%
This implementation with fine-tune 99.74%
This implementation 99.72%
Implementation by @gram-ai 99.70%
Implementation by @XifengGuo 99.66%
Implementation by @naturomics 99.64%

Matrix capsules with EM routing

Hinton G E, Sabour S, Frosst N. Matrix capsules with EM routing[C]//ICLR 2018.
With the best hyperparameters on smallNORB dataset in the paper, training will takes 40 hours with eight Tesla P40.

Best Test Accuracy Training Speed
Paper 98.2% -
This Implementation 90.9% < 1s/iter with 8 Tesla P40
Implementation by @www0wwwjs1 91.8% 25s/iter with 1 Tesla P40