In this section we explain the compact representation of neural networks, the vector notation for neuron layers and both the vector and matrix notation for bias and weight parameters.