SCA BIBREF5 softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words, i.e., replacing the one-hot representation of a word by a distribution provided by a language model over the vocabulary. 
 Question: How does soft contextual data augmentation work?
softly augments a randomly chosen word in a sentence by its contextual mixture of multiple related words replacing the one-hot representation of a word by a distribution provided by a language model over the vocabulary