Chapters

This chapter introduces the basic mathematical concepts that are prerequisite for most optimization methods.

Building on the mathematical concepts of the last chapter, we can now start with actual optimization problems.

The first set of problems we will have a look at are univariate optimization problems.

The first type of optimization methods we will have a look at are first order methods.

The next type of optimization methods we will have a look at are second order methods.

In this chapter we take a look into constrained optimization approaches.

In this chapter we take a look into simple derivative free approaches.

In this chapter we take a look into Evolutionary Algorithms.

In this chapter we take a look into Bayesian Optimization.