In this subchapter we further examine the gradient descent algorithm and take a closer look into its convergence behaviour.