Function marian::swish(Expr)

• Defined in File expression_operators.cpp

Function Documentation

Expr marian::swish(Expr a)

Swish node.

Computes the Swish activation function with \(\beta=1 \)

\[ \operatorname{swish}(x) = x \cdot \operatorname{sigmoid}(\beta x) \]

See

SwishNodeOp