To identify new keywords in the selected microposts, we again leverage crowdsourcing, as humans are typically better than machines at providing specific explanations BIBREF18, BIBREF19. In the crowdsourcing task, workers are first asked to find those microposts where the model predictions are deemed correct. Then, from those microposts, workers are asked to find the keyword that best indicates the class of the microposts as predicted by the model. 
 Question: How is the keyword specific expectation elicited from the crowd?
workers are first asked to find those microposts where the model predictions are deemed correct  asked to find the keyword that best indicates the class of the microposts