In this subchapter, we introduce more recent sequence data modelling techniques such as attention and transformers.