uch as attention.py, resnet.py, embeddings.py, etc… Note: This is in stark contrast to Transformers’ modeling files and shows that models do not really follow the single-file policy. Models intend to expose complexity, just like PyTorch’s Module class, and give clear error messages. Models all inherit from ModelMixin and ConfigMixin. Models can be optimized for performance when it doesn’t demand major code changes, keeps backward compatibility,