File size: 283 Bytes
5fa1a76
 
 
 
 
1
2
3
4
5
Create a pretrained model with [~PreTrainedModel.from_pretrained]:

model = DistilBertModel.from_pretrained("distilbert/distilbert-base-uncased")

When you load pretrained weights, the default model configuration is automatically loaded if the model is provided by 🤗 Transformers.