Skip to content

AAAI & CVPR 2016: Preconditioned Stochastic Gradient Langevin Dynamics (pSGLD)

Notifications You must be signed in to change notification settings

ChunyuanLI/pSGLD

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 

Repository files navigation

pSGLD

Preconditioned Stochastic Gradient Langevin Dynamics (pSGLD)

Links: Implementation on TensorFlow Website

Simulation (2D Gaussian Example in Figure 1 of the paper)

  • Simulation 1 provides Average Absolute Error of Sample Covariance vs AutoCorrelation Time (ACT)
  • Simulation 2 provides first 600 samples from SGLD and pSGLD

Experiments on Deep Neural Networks (Keep updating)

  • Start to run 'test_FNN_mnist.m' to test a 2-layer FNN with 400 hidden units each .
  • You may also modify line 'linSizes = [400 400 data.outSize]' to other configurations.

Citation

Please cite our AAAI paper if it helps your research:

@inproceedings{pSGLD_AAAI2016,
  title={Preconditioned stochastic gradient Langevin dynamics for deep neural networks},
  author={Li, Chunyuan and Chen, Changyou and Carlson, David and Carin, Lawrence},
  booktitle={AAAI},
  Year  = {2016}
}

About

AAAI & CVPR 2016: Preconditioned Stochastic Gradient Langevin Dynamics (pSGLD)

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages