Function marian::swish(Expr)

Function Documentation

Expr marian::swish(Expr a)

Swish node.

Computes the Swish activation function with \(\beta=1 \)

\[ \operatorname{swish}(x) = x \cdot \operatorname{sigmoid}(\beta x) \]
See

SwishNodeOp