Extra Chapter: Online Learning - Online Convex Optimization 2
In this chapter we explain the connection between Online Gradient Descent (OGD) and Follow the Regularized Leader (FTRL) via linearization of convex functions and how this implies regret bounds for OGD.