More specifically, in our model we use the context of the word to predict its label and by doing so our model learns label-aware context for each word in the sentence. In order to improve the interactivity between the word representation and its context, we increase the mutual information between the word representations and its context. 
 Question: How does their model utilize contextual information for each work in the given sentence in a multi-task setting? setting?
we use the context of the word to predict its label and by doing so our model learns label-aware context for each word in the sentence