In this section we explain the backpropagation for RNN as well as exploiding and vanishing gradients.