What does 'Linear regularities among words' mean?
By linear regularities among words, he meant that "Vectorized form of words should follow linear additive properties!"

V("King") - V("Man") + V("Woman") ~ V("Queen)