Resources
Here, we provide a list of useful resources for working on the competition.
HMC samples
We provide the HMC checkpoints on CIFAR-10, CIFAR-100 and IMDB datasets here. We will upload HMC samples on other model-dataset pairs over time.
Code
-
google-research/bnn_hmc: An efficient JAX implementation of several baselines for Bayesian neural networks is available
-
TensorFlow Probability is a library for probabilistic reasoning and statistical analysis that supports JAX and TensorFlow
Tutorials
-
Bayesian Deep Learning and Probabilistic Model Construction by Andrew Gordon Wilson
-
Deep Learning with Bayesian Principles by Mohammad Emtiyaz Khan
-
Practical Uncertainty Estimation & Out-of-Distribution Robustness in Deep Learning by Dustin Tran, Jasper Snoek and Balaji Lakshminarayanan
Papers
What Are Bayesian Neural Network Posteriors Really Like?
Pavel Izmailov, Sharad Vikram, Matthew D. Hoffman, Andrew Gordon Wilson
Bayesian Deep Learning and a Probabilistic Perspective of Generalization
Andrew Gordon Wilson, Pavel Izmailov
Dangers of Bayesian Model Averaging under Covariate Shift
Pavel Izmailov, Patrick Nicholson, Sanae Lotfi, Andrew Gordon Wilson
A Systematic Comparison of Bayesian Deep Learning Robustness in Diabetic Retinopathy Tasks
Angelos Filos, Sebastian Farquhar, Aidan N. Gomez, Tim G. J. Rudner, Zachary Kenton, Lewis Smith, Milad Alizadeh, Arnoud de Kroon, Yarin Gal
‘In-Between’ Uncertainty in Bayesian Neural Networks
Andrew Y. K. Foong, Yingzhen Li, José Miguel Hernández-Lobato, Richard E. Turner
Practical Deep Learning with Bayesian Principles
Kazuki Osawa, Siddharth Swaroop, Anirudh Jain, Runa Eschenhagen, Richard E. Turner, Rio Yokota, Mohammad Emtiyaz Khan
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles
Balaji Lakshminarayanan, Alexander Pritzel, Charles Blundell
A Simple Baseline for Bayesian Uncertainty in Deep Learning
Wesley Maddox, Timur Garipov, Pavel Izmailov, Dmitry Vetrov, Andrew Gordon Wilson
Quality of Uncertainty Quantification for Bayesian Neural Network Inference
Jiayu Yao, Weiwei Pan, Soumya Ghosh, Finale Doshi-Velez