⚡ Simulator: ReLU Activation Function
ReLU(x) = max(0, x)
x =
x = -2.50 → ReLU(x) = 0.00
ReLU function curve
Feature map: before / after
Description: Figure 9.5: Interactive simulator of the ReLU activation function: drag the control to see how negative values are zeroed out and positive values are preserved, both in the curve and in a real feature map.