Mariia VLADIMIROVA (Inria Grenoble) – Prior specification for Bayesian deep learning models

Carte non disponible

Date/heure
Date(s) - 17/02/2020
14 h 00 min - 17 h 00 min

Emplacement
FRUMAM, St Charles (2ème étage)

Catégories


Title: 
Prior specification for Bayesian deep learning models
 
Abstract: 
Neural networks (NNs), and their deep counterparts, have largely been used in many research areas such as image analysis, signal processing, or reinforcement learning, just to name a few. The impressive performance provided by such machine learning approaches has greatly motivated research that aims at a better understanding the driving mechanisms behind their effectiveness. In particular, the study of the NNs distributional properties through Bayesian analysis has recently gained much attention.
In this seminar we firstly describe the necessary notations and statistical background for Bayesian NNs. Then we consider its distributional properties and novel theoretical insight on distributions at the units level. Under the assumption of independent and normally distributed weights, we establish that the induced prior distribution on the units before and after activation becomes increasingly heavy-tailed with the depth of the layer. Lastly, we discuss this property in terms of a regularizing mechanism and corroborate it with experimental simulation results.

Articles similaires

Commencez à saisir votre recherche ci-dessus et pressez Entrée pour rechercher. ESC pour annuler.

Secured By miniOrange
Aller à la barre d’outils