class_docstr: A tokenizer that processes tokenized text and merges multi-word expressions
  into single tokens.
docstr: Initialize the multi-word tokenizer with a list of expressions and a
  separator
  
  :type mwes: list(list(str))
  :param mwes: A sequence of multi-word expressions to be merged, where
      each MWE is a sequence of strings.
  :type separator: str
  :param separator: String that should be inserted between words in a multi-word
      expression token. (Default is '_')
docstr_tok: ["Initialize","the","multi-word","tokenizer","with","a","list","of","expressions","and","a","separator",":","type","mwes",":","list","(","list","(","str",")",")",":","param","mwes",":","A","sequence","of","multi-word","expressions","to","be","merged",",","where","each","MWE","is","a","sequence","of","strings",".",":","type","separator",":","str",":","param","separator",":","String","that","should","be","inserted","between","words","in","a","multi-word","expression","token",".","(","Default","is","'","_","'",")"]
code: def __init__(self, mwes=None, separator="_"):
      """Initialize the multi-word tokenizer with a list of expressions and a
      separator
  
      :type mwes: list(list(str))
      :param mwes: A sequence of multi-word expressions to be merged, where
          each MWE is a sequence of strings.
      :type separator: str
      :param separator: String that should be inserted between words in a multi-word
          expression token. (Default is '_')
  
      """
      if not mwes:
          mwes = []
      self._mwes = Trie(mwes)
      self._separator = separator
  
imports: from nltk.tokenize.api import TokenizerI
  from nltk.util import Trie
label_desc: Use image node_id 1 to create a new MWETokenizer object from inherited base classes: TokenizerI with example: obj = MWETokenizer(mwes, separator)