We apply attention probes to the task of identifying the existence and type of dependency relation between two words. Our first experiment is an exploratory visualization of how word sense affects context embeddings.  
 Question: What linguistic features were probed for?
dependency relation between two words word sense