For the two single sentence tasks—the syntax-oriented CoLA task and the SST sentiment task—we find somewhat deteriorated performance. 
 Question: Does the additional training on supervised tasks hurt performance in some tasks?
Yes