Chapters

Chapter 01: Mathematical Concepts
This chapter introduces the basic mathematical concepts that are prerequisite for most optimization methods.

Chapter 02: Optimization problems
Building on the mathematical concepts of the last chapter, we can now start with actual optimization problems.

Chapter 03: Univariate Optimization
The first set of problems we will have a look at are univariate optimization problems.

Chapter 04: First order methods
The first type of optimization methods we will have a look at are first order methods.

Chapter 05: Second order methods
The next type of optimization methods we will have a look at are second order methods.

Chapter 06: Constrained Optimization
In this chapter we take a look into constrained optimization approaches.

Chapter 07: Derivative Free Optimization
In this chapter we take a look into simple derivative free approaches.

Chapter 08: Evolutionary Algorithms
In this chapter we take a look into Evolutionary Algorithms.

Chapter 10: Bayesian Optimization
In this chapter we take a look into Bayesian Optimization.