Rectified Linear Unit

---

aliases: - ReLU

An Activation Function used in Feedforward Neural Networks defined by

$$g(a)=\max \left(0,a\right)$$

where $a$ is the activation value calculated by a neuron.