File size: 317 Bytes
5fa1a76
 
 
 
 
 
1
2
3
4
5
6
However, you can still replace - some or all of - the default model configuration attributes with your own if you'd like:

tf_model = TFDistilBertModel.from_pretrained("distilbert/distilbert-base-uncased", config=my_config)

Model heads
At this point, you have a base DistilBERT model which outputs the hidden states.