title: Can't Import BertTokenizer
body: <p>I am attempting to use the BertTokenizer part of the transformers package. First I install as below.</p>
  <pre><code>pip install transformers
  </code></pre>
  <p>Which says it succeeds.</p>
  <p>When I try to import parts of the package as below I get the following.</p>
  <pre><code> from transformers import BertTokenizer
  Traceback (most recent call last):
  
    File &quot;&lt;ipython-input-2-89505a24ece6&gt;&quot;, line 1, in &lt;module&gt;
      from transformers import BertTokenizer
  
    File &quot;C:\Users\User\anaconda3\lib\site-packages\transformers\__init__.py&quot;, line 22, in &lt;module&gt;
      from .integrations import (  # isort:skip
  
    File &quot;C:\Users\User\anaconda3\lib\site-packages\transformers\integrations.py&quot;, line 42, in &lt;module&gt;
      from .trainer_utils import PREFIX_CHECKPOINT_DIR, BestRun  # isort:skip
  
    File &quot;C:\Users\User\anaconda3\lib\site-packages\transformers\trainer_utils.py&quot;, line 10, in &lt;module&gt;
      from .tokenization_utils_base import ExplicitEnum
  
    File &quot;C:\Users\User\anaconda3\lib\site-packages\transformers\tokenization_utils_base.py&quot;, line 31, in &lt;module&gt;
      from tokenizers import AddedToken
  
    File &quot;C:\Users\User\anaconda3\lib\site-packages\tokenizers\__init__.py&quot;, line 17, in &lt;module&gt;
      from .tokenizers import Tokenizer, Encoding, AddedToken
  
  ModuleNotFoundError: No module named 'tokenizers.tokenizers'
  </code></pre>
  <p>The package is detailed here so I think it should be available
  <a href="https://huggingface.co/transformers/model_doc/bert.html" rel="nofollow noreferrer">https://huggingface.co/transformers/model_doc/bert.html</a></p>