Chapter 13.01: Entropy I

We introduce entropy, which expresses the expected information for discrete random variables, as a central concept in information theory.

Lecture video

Lecture slides