<h2 dir="auto"><g-emoji class="g-emoji" alias="question" fallback-src="https://github.githubassets.com/images/icons/emoji/unicode/2753.png">❓</g-emoji> Questions &amp; Help</h2>
<p dir="auto">For many students,who haven't large GPU,so they will use small model(eg albert),hence I hope you will support loading albert, Tkanks so much!</p>
<h1 dir="auto">🌟New model addition</h1>
<h2 dir="auto">Model description</h2>
<p dir="auto">ALBERT is "A Lite" version of BERT, a popular unsupervised language representation learning algorithm. ALBERT uses parameter-reduction techniques that allow for large-scale configurations, overcome previous memory limitations, and achieve better behavior with respect to model degradation.</p>
<p dir="auto">For a technical description of the algorithm, see our paper:</p>
<p dir="auto">ALBERT: A Lite BERT for Self-supervised Learning of Language Representations</p>
<p dir="auto">Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut</p>
<h2 dir="auto">Open Source status</h2>
<ul class="contains-task-list">
<li class="task-list-item"><input type="checkbox" id="" disabled="" class="task-list-item-checkbox"> the model implementation is available: <a href="https://github.com/google-research/google-research/tree/master/albert">https://github.com/google-research/google-research/tree/master/albert</a>.</li>
</ul>
<p dir="auto">I just want to ask whether you guys have plan to add ALBERT in near future.</p>