awesome-bayesian-deep-learning

A curated list of resources dedicated to bayesian deep learning

Table of Contents

• Theory
  • Papers / Thesis

Theory

Papers / Thesis

2013:

1. Deep gaussian processes|Andreas C. Damianou,Neil D. Lawrence|2013
   Source: http://www.jmlr.org/proceedings/papers/v31/damianou13a.pdf

2014:

1. Avoiding pathologies in very deep networks|D Duvenaud, O Rippel, R Adams|2014
   Source: http://www.jmlr.org/proceedings/papers/v33/duvenaud14.pdf
2. Nested variational compression in deep Gaussian processes|J Hensman, ND Lawrence|2014 Source: https://arxiv.org/abs/1412.1370

2015:

1. On Modern Deep Learning and Variational Inference |Yarin Gal, Zoubin Ghahramani|2015
   Source: http://www.approximateinference.org/accepted/GalGhahramani2015.pdf
2. Rapid Prototyping of Probabilistic Models: Emerging Challenges in Variational Inference |Yarin Gal, |2015
   Source: http://www.approximateinference.org/accepted/Gal2015.pdf
3. Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference |Yarin Gal, Zoubin Ghahramani|2015
   Source: http://arxiv.org/abs/1506.02158
4. Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning |Yarin Gal, Zoubin Ghahramani|2015
   Source: http://arxiv.org/abs/1506.02142
5. Dropout as a Bayesian Approximation: Insights and Applications |Yarin Gal, |2015 Source: https://sites.google.com/site/deeplearning2015/33.pdf?attredirects=0
6. Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inference |Yarin Gal, Zoubin Ghahramani|2015
   Source: http://arxiv.org/abs/1506.02158
7. Scalable Variational Gaussian Process Classification|J Hensman, AGG Matthews, Z Ghahramani|2015 Source: http://www.jmlr.org/proceedings/papers/v38/hensman15.pdf

2016:

1. Relativistic Monte Carlo | Xiaoyu Lu| 2016
   Source: https://arxiv.org/abs/1609.04388
2. Risk versus Uncertainty in Deep Learning: Bayes, Bootstrap and the Dangers of Dropout | Ian Osband| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_4.pdf
3. Semi-supervised deep kernel learning|Neal Jean, Michael Xie, Stefano Ermon|2016
   Source: http://bayesiandeeplearning.org/papers/BDL_5.pdf
4. Categorical Reparameterization with Gumbel-Softmax| Eric Jang, Shixiang Gu,Ben Poole| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_8.pdf Video: https://www.youtube.com/watch?v=JFgXEbgcT7g
5. Learning to Optimise: Using Bayesian Deep Learning for Transfer Learning in Optimisation| Jonas Langhabel, Jannik Wolff| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_9.pdf
6. One-Shot Learning in Discriminative Neural Networks| Jordan Burgess,James Robert Lloyd,Zoubin Ghahramani| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_10.pdf
7. Distributed Bayesian Learning with Stochastic Natural-gradient Expectation Propagation| Leonard Hasenclever, Stefan Webb| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_11.pdf
8. Knots in random neural networks| Kevin K. Chen| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_2.pdf
9. Discriminative Bayesian neural networks know what they do not know | Christian Leibig, Siegfried Wahl| 2016
   Source: http://bayesiandeeplearning.org/papers/BDL_12.pdf
10. Variational Inference in Neural Networks using an Approximate Closed-Form Objective|Wolfgang Roth and Franz Pernkopf|2016
    Source: http://bayesiandeeplearning.org/papers/BDL_13.pdf
11. Combining sequential deep learning and variational Bayes for semi-supervised inference| Jos van der Westhuizen, Dr. Joan Lasenby| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_14.pdf
12. Importance Weighted Autoencoders with Random Neural Network Parameters| Daniel Hernández-Lobato,Thang D. Bui,Yinzhen Li| 2016 Stefan Webb| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_15.pdf
13. Variational Graph Auto-Encoders| Thomas N. Kipf,Max Welling| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_16.pdf
14. Dropout-based Automatic Relevance Determination| Dmitry Molchanov, Arseniy Ashuha, Dmitry Vetrov| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_18.pdf
15. Scalable GP-LSTMs with Semi-Stochastic Gradients| Maruan Al-Shedivat, Andrew Gordon Wilson, Yunus Saatchi, Zhiting Hu and Eric P. Xing| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_19.pdf
16. Approximate Inference for Deep Latent Gaussian Mixture Models|Eric Nalisnick, Lars Hertel and Padhraic Smyth|2016
    Source: http://bayesiandeeplearning.org/papers/BDL_20.pdf
17. Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Training | Dilin Wang, Yihao Feng and Qiang Liu| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_21.pdf Video: https://www.youtube.com/watch?v=fi-UUQe2Pss
18. Learning and Policy Search in Stochastic Dynamical Systems with Bayesian Neural Networks| Stefan Depeweg, José Miguel Hernández-Lobato, Finale Doshi-Velez and Steffen Udluft| 2016
    Source: https://arxiv.org/abs/1605.07127
19. Accelerating Deep Gaussian Processes Inference with Arc-Cosine Kernels | Kurt Cutajar, Edwin V. Bonilla, Pietro Michiardi and Maurizio Filippone| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_24.pdf
20. Embedding Words as Distributions with a Bayesian Skip-gram Model | Arthur Bražinskas, Serhii Havrylov and Ivan Titov| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_25.pdf
21. Variational Inference on Deep Exponential Family by using Variational Inferences on Conjugate Models|Mohammad Emtiyaz Khan and Wu Lin|2016
    Source: http://bayesiandeeplearning.org/papers/BDL_26.pdf
22. Neural Variational Inference for Latent Dirichlet Allocation| Akash Srivastava and Charles Sutton| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_27.pdf
23. Hierarchical Bayesian Neural Networks for Personalized Classification | Ajjen Joshi, Soumya Ghosh, Margrit Betke and Hanspeter Pfister| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_28.pdf
24. Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles| Balaji Lakshminarayanan, Alexander Pritzel and Charles Blundell| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_29.pdf
25. Asynchronous Stochastic Gradient MCMC with Elastic Coupling| Jost Tobias Springenberg, Aaron Klein, Stefan Falkner and Frank Hutter| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_30.pdf
26. The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables|Chris J. Maddison, Andriy Mnih and Yee Whye Teh| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_31.pdf
27. Known Unknowns: Uncertainty Quality in Bayesian Neural Networks | Ramon Oliveira, Pedro Tabacof and Eduardo Valle| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_32.pdf
28. Normalizing Flows on Riemannian Manifolds |Mevlana Gemici, Danilo Rezende and Shakir Mohamed|2016
    Source: http://bayesiandeeplearning.org/papers/BDL_33.pdf
29. Posterior Distribution Analysis for Bayesian Inference in Neural Networks| Pavel Myshkov and Simon Julier| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_34.pdf
30. Deep Bayesian Active Learning with Image Data| Yarin Gal, Riashat Islam and Zoubin Ghahramani| 2016
    Stefan Webb| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_35.pdf
31. Bottleneck Conditional Density Estimators|Rui Shu, Hung Bui and Mohammad Ghavamzadeh| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_36.pdf
32. A Tighter Monte Carlo Objective with Renyi alpha-Divergence Measures| Stefan Webb and Yee Whye Teh| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_37.pdf
33. Bayesian Neural Networks for Predicting Learning Curves| Aaron Klein, Stefan Falkner, Jost Tobias Springenberg and Frank Hutter| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_38.pdf
34. Nested Compiled Inference for Hierarchical Reinforcement Learning|Tuan Anh Le, Atılım Güneş Baydin and Frank Wood|2016
    Source: http://bayesiandeeplearning.org/papers/BDL_41.pdf
35. Open Problems for Online Bayesian Inference in Neural Networks | Robert Loftin and David Roberts| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_42.pdf
36. Deep Probabilistic Programming| Dustin Tran, Matt Hoffman, Kevin Murphy, Rif Saurous, Eugene Brevdo, and David Blei| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_43.pdf
37. Markov Chain Monte Carlo for Deep Latent Gaussian Models |Matthew Hoffman| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_44.pdf
38. Semi-supervised Active Learning with Deep Probabilistic Generative Models | Amar Shah and Zoubin Ghahramani| 2016
    Source: http://bayesiandeeplearning.org/papers/BDL_43.pdf
39. Thesis: Uncertainty in Deep Learning | Yarin Gal| PhD Thesis, 2016
    Source: http://mlg.eng.cam.ac.uk/yarin/thesis/thesis.pdf, Blog: http://mlg.eng.cam.ac.uk/yarin/blog_2248.html
    
40. Deep survival analysis|R. Ranganath, A. Perotte, N. Elhadad, and D. Blei|2016
    Source: http://www.cs.columbia.edu/~blei/papers/RanganathPerotteElhadadBlei2016.pdf
41. Towards Bayesian Deep Learning: A Survey| Hao Wang, Dit-Yan Yeung|2016
    Source: https://arxiv.org/pdf/1604.01662

2017

1. Dropout Inference in Bayesian Neural Networks with Alpha-divergences |Yingzhen Li, Yarin Gal|2017
   Source: https://arxiv.org/abs/1703.02914
2. What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? |Alex Kendall, Yarin Gal|2017
   Source: https://arxiv.org/abs/1703.04977