Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
One example of self-supervised learning is masked language modeling, where a model is passed sentences with a proportion of its tokens removed and learns to predict the missing tokens.