title: Transformers - How to load pytorch_model.bin in torch version 1.4.0 (Albert)
body: <p>torch version 1.4.0
  I execute run_language_modeling.py and save the model. However, when I load the saved model, &quot;OSError: Unable to load weights from pytorch checkpoint file. If you tried to load a Pytorch model from a TF 2.0 checkpoint, please set from_tf=True&quot; occurs.</p>
  <p>If I install torch==1.6.0, it is successful to load model. However, I have to use torch version 1.4.0 and torchvision 0.5.0. How can I load pytorch_model.bin in torch 1.4.0???</p>
  <p>++ I tried to train run_language_modeling.py in torch version 1.4.0, but  it cannot import &quot;torch.optim.lr_scheduler&quot; thus the train code cannot be executed.</p>
  <p>Thus my question is
  [1] How can I load pytorch_model.bin in torch version 1.4.0   / or
  [2] How can I train run_language_modeling.py in torch version 1.4.0?</p>