ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
From statwiki
Contents
Presented by
Maziar Dadbin
Introduction
Motivation
Model details
Factorized embedding parameterization
Cross-layer parameter sharing
Inter-sentence coherence loss
