anchor.diff:      |  algorithm in Python, optimized for readability rather than performance:
   
   +code.
  -    def tokenizer_pseudo_code(text, find_prefix, find_suffix,
  -                              find_infixes, special_cases):
  +    def tokenizer_pseudo_code(text, special_cases,
  +                              find_prefix, find_suffix, find_infixes):
           tokens = []
           for substring in text.split(' '):
               suffixes = []
  
positive.code: 
  p
      |  Let's imagine you wanted to create a tokenizer for a new language. There
      |  are four things you would need to define:
  
  +list("numbers")
      +item
  
negative.code:     prefix_re = re.compile(r'''[\[\(&quot;']''')
      suffix_re = re.compile(r'''[\]\)&quot;']''')
      infix_re = re.compile(r'''[-~]''')
      simple_url_re = re.compile(r'''^https?://''')
      def create_tokenizer(nlp):
          return Tokenizer(nlp.vocab,
                  rules={},
                  prefix_search=prefix_re.search,
                  suffix_search=suffix_re.search,
                  infix_finditer=infix_re.finditer,
                  token_match=simple_url_re.match
                  )
  
      nlp = spacy.load('en', create_make_doc=create_tokenizer)
  
  