Chapter 08.04: Decoding Hyperparameters & Practical considerations

In this chapter you will learn how to use the different decoding strategies in practice. When using models from huggingface you can choose the decoding strategy by specifying the hyperparameters of the generate method of those models.

Lecture Slides

Additional Resources