We explain challenges in optimization related to action function and introduce activation for hidden and output units.
video