Chapter 09.03: Emergent Abilities

Various researchers have reported that LLMs seem to have emergent abilities. These are sudden appearances of new abilities when Large Language Models (LLMs) are scaled up. In this section we introduce the concept of emergent abilities and discuss a potential counter argument for the concept of emergence.

Lecture Slides

Download »slides-93-emergent-abilities.pdf«

Additional Resources

• Article: Large Language Models’ Emergent Abilities Are a Mirage

• « Chapter 09.02: Chain-of-thought Prompting