Function marian::leakyrelu(Expr)

• Defined in File expression_operators.cpp

Function Documentation

Expr marian::leakyrelu(Expr a)

Leaky ReLU (LeakyReLU).

Computes the LeakyReLU activation for the expression Activation function:

\[\begin{split} \operatorname{leakyrelu}(x) = \begin{cases} 0.01x & \text{if } x \leq 0 \\ x & \text{if } x > 0 \end{cases} \end{split}\]

See

PReLUNodeOp