Models do not follow the single-file policy and should make use of smaller model building blocks, such as attention.py, resnet.py, embeddings.py, etc… Note: This is in stark contrast to Transformers’ modeling files and shows that models do not really follow the single-file policy.