Data Science & ML
Basic
ReLU Activation
Rectified Linear Unit: outputs the input if positive, else zero.
Formula
Variables
xInput value
Example
f(-3)=0, f(5)=5
Did You Know?
ReLU is the most widely used activation function in deep learning.
Rectified Linear Unit: outputs the input if positive, else zero.
f(-3)=0, f(5)=5
ReLU is the most widely used activation function in deep learning.