Function marian::prelu(Expr, float)¶
Defined in File expression_operators.cpp
Function Documentation¶
-
Expr
marian
::
prelu
(Expr a, float alpha = 0.01) Parametric Rectified Linear Unit (PReLU).
Computes the Parametric ReLU activation for the expression
\[\begin{split} \operatorname{leakyrelu}(x) = \begin{cases} \alpha x & \text{if } x \leq 0 \\ x & \text{if } x > 0 \end{cases} \end{split}\]- See
- Note
alpha
is not trainable.