Class Adam

• Defined in File optimizers.h

Inheritance Relationships

Base Type

• public marian::OptimizerBase (Class OptimizerBase)

Class Documentation

class Adam : public marian::OptimizerBase

Adam optimizer.

https://arxiv.org/pdf/1412.6980v8.pdf

with Frank’s modifications for automatic hyper-parameter adjustment.

Public Functions

Adam(Ptr<Options> options)

void load(std::vector<io::Item> &items, const std::vector<Ptr<OptimizerBase>> &opts, const std::vector<Ptr<Backend>> &backends, const ScatterStateFunc &scatterFn, bool isMainProcess)

void save(std::vector<io::Item> &items, const std::vector<Ptr<OptimizerBase>> &opts, const GatherStateFunc &gatherFn, bool isMainProcess)

std::vector<Tensor> getShards()