File size: 289 Bytes
5fa1a76
 
 
 
 
 
 
1
2
3
4
5
6
7
Load your custom configuration attributes into the model:

from transformers import DistilBertModel
my_config = DistilBertConfig.from_pretrained("./your_model_save_path/config.json")
model = DistilBertModel(my_config)

This creates a model with random values instead of pretrained weights.