Class Adam

Inheritance Relationships

Base Type

Class Documentation

class Adam : public marian::OptimizerBase

Adam optimizer.

https://arxiv.org/pdf/1412.6980v8.pdf

with Frank’s modifications for automatic hyper-parameter adjustment.

Public Functions

Adam(Ptr<Options> options)
void load(std::vector<io::Item> &items, const std::vector<Ptr<OptimizerBase>> &opts, const std::vector<Ptr<Backend>> &backends, const ScatterStateFunc &scatterFn, bool isMainProcess)
void save(std::vector<io::Item> &items, const std::vector<Ptr<OptimizerBase>> &opts, const GatherStateFunc &gatherFn, bool isMainProcess)
std::vector<Tensor> getShards()