Function marian::layerNorm(Expr, Expr, Expr, float)

• Defined in File expression_operators.cpp

Function Documentation

Expr marian::layerNorm(Expr x, Expr gamma, Expr beta = nullptr, float eps = 1e-9)

Applies layer normalization over the last dimension.

\[ \frac{x - \mathrm{E}[x]}{\sqrt{\mathrm{Var}[x] + \mathrm{eps}}} \times \gamma + \beta \]

See

LayerNormalizationOp