Function marian::prelu(Expr, float)

Function Documentation

Expr marian::prelu(Expr a, float alpha = 0.01)

Parametric Rectified Linear Unit (PReLU).

Computes the Parametric ReLU activation for the expression

\[\begin{split} \operatorname{leakyrelu}(x) = \begin{cases} \alpha x & \text{if } x \leq 0 \\ x & \text{if } x > 0 \end{cases} \end{split}\]
See

PReLUNodeOp

Note

alpha is not trainable.