Wiki: Lecture 7 – Understanding and Improving Deep Learning With Random Matrix Theory


#1

Lecture Video: Understanding and Improving Deep Learning With Random Matrix Theory (Jeffrey Pennington)

Readings:
Geometry of Neural Network Loss Surfaces via Random Matrix Theory
Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice
Nonlinear random matrix theory for deep learning