In this section we explain backpropagation for RNN as well as the phenomenon of exploding and vanishing gradients.