Chapter 23: Online Learning
This chapter introduces online learning.
-
Chapter 23.01: Introduction
In this chapter we explain the differences between online and batch learning, the extended learning protocol in online learning and the strategies to measure performance in online learning.
-
Chapter 23.02: Simple Online Learning Algorithm
In this chapter we introduce the formalization of online learning algorithms and the FTL algorithm.
-
Chapter 23.03: Follow the Leader on OLO problems
In this chapter we introduce OLO problems and explain why some FTL might fail on these problems.
-
Chapter 23.04: Follow the regularized Leader
In this chapter we introduce FTLR as a stable alternative to FTL.
-
Chapter 23.05: Follow the Leader on OQO problems
In this chapter we prove that FTL works for online quadratic problems.
-
Chapter 23.06: Online Convex optimization 1
In this chapter we introduce the class of online convex optimization problems and derive the online gradient descent as a suitable learning algorithm for such cases.
-
Chapter 23.07: Online Convex optimization 2
In this chapter we explain the connection between OGD and FTRL via linearization of convex functions and how this implies regret bounds for OGD.