Chapter 11: Recap of the Transformer

This chapter will review the architectural components of the Transformer, which is (in some variant) still the backbone of most contemporary large language models. For students taking this course, it is crucial to be familiar with these basics to be able to follow along.