In this section, we summarize several of the most prominent challenges regarding training of deep neural networks such as Ill-Conditioning Local Minima, Saddle Points, Cliffs and Exploding Gradients.
video
