Orthogonal Representations in NLP
Let&#x27;s say I have a word I want to retrieve the &quot;sentiment&quot;, say &quot;cow.&quot; A cow is an animal.<p>Obviously in a given model (i.e. word2vec) the representation of animal and cow will be correlated. I was wondering, how can I extract the orthogonal component of the word &quot;cow&quot; that is not driven by &quot;animal&quot; and capture its sentiment?