# BERT trained with YFCC15M with the same capacity with CLIP text encoder


- Training epochs 32
- Valid PPL final: 15.53 



{}
transformers pytorch bert fill-mask autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #bert #fill-mask #autotrain_compatible #endpoints_compatible #region-us 

# BERT trained with YFCC15M with the same capacity with CLIP text encoder


- Training epochs 32
- Valid PPL final: 15.53 



# BERT trained with YFCC15M with the same capacity with CLIP text encoder


- Training epochs 32
- Valid PPL final: 15.53
TAGS
#transformers #pytorch #bert #fill-mask #autotrain_compatible #endpoints_compatible #region-us 
 # BERT trained with YFCC15M with the same capacity with CLIP text encoder


- Training epochs 32
- Valid PPL final: 15.53
passage: TAGS
#transformers #pytorch #bert #fill-mask #autotrain_compatible #endpoints_compatible #region-us 
# BERT trained with YFCC15M with the same capacity with CLIP text encoder


- Training epochs 32
- Valid PPL final: 15.53