title: How can I find token similarity in Spacy?
body: <p>I am trying to calculate token similarity in spacy. I.e. how close word tokens are to one another. I am using spacy version 2.0.5. Here is my trivial example. </p>
  
  <pre><code>import spacy
  from spacy.lang.en import English
  from spacy.tokenizer import Tokenizer
  
  nlp = spacy.load('en') 
  
  x = nlp(u'apple')
  y = nlp(u'apple')
  
  x.similarity(y)
  </code></pre>
  
  <p>This returns -81216639937292144.0 but I had expected it to be 1.0. </p>
  
  <p>In addition </p>
  
  <pre><code>x = nlp(u'apple')
  y = nlp(u'apples')
  x.similarity(y)
  </code></pre>
  
  <p>returns 0.0038385278814858344 which seems wrong as well. </p>
  
  <p>How should I be doing this token similarity so that it works? I am really trying to stay within Spacy (rather than using a different string distance package) but would also welcome suggestions if this just can't be done in spacy. </p>