In this subchapter we take a look into further details of SGD such as the effect of decreasing the step size, stopping rules and SGD with momentum.
