ALBERT: A Lite BERT for Self-supervised Learning of Language Representations: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
No edit summary |
||
Line 14: | Line 14: | ||
===Inter-sentence coherence loss=== | ===Inter-sentence coherence loss=== | ||
[[File: | [[File:SOPvsNSP.png]] | ||
===Removing dropout=== | ===Removing dropout=== |