Class BertMaskedLM

Inheritance Relationships

Base Type

Class Documentation

class BertMaskedLM : public marian::ClassifierBase

This is a model that pretrains BERT for classification.

This is also a Classifier, but compared to the BertClassifier above needs the BERT-specific information from BertBatch as this is self-generating its labels from the source. Labels are dynamically created as complements of the masking process.

Public Functions

Ptr<ClassifierState> apply(Ptr<ExpressionGraph> graph, Ptr<data::CorpusBatch> batch, const std::vector<Ptr<EncoderState>> &encoderStates)
virtual void clear()