Chapter 4.02: Step size and optimality

In this subchapter we take a look at the impact that the chosen step size can have on optimization. Furthermore, we look into certain methods for determining the value of the step size such as the Armijo rule.