Chapter 09.03: Basic Techniques

In this section we familiarize ourselves with two simple but popular tuning strategies, namely grid search and random search, and discuss their advantages and disadvantages.

Lecture video

Lecture slides

Quiz

--- shuffle_questions: false --- ## Which statements are true? - [x] How well tuning works depends on the learner and the impact of the hyperparameters on that learner. - [ ] Grid search often works better than random search. - [x] Grid search scales exponentially with the dimension of the search space. - [x] Grid search evaluates many points from the search space that aren't of interest. - [x] Random search works often better due to its better exploration of the search space. - [ ] Random search scales very well with the dimension of the search space. - [ ] Random search as well as grid search has the problem of discretization.