In this section, we report settings for the experiments performed in this paper. All experiments described in this paper were conducted on NVIDIA Volta V100 graphics processing units (GPUs) with 32 GB of memory per node and 2 GPUs per node. All models were implemented in PyTorch and trained with the Distributed Data Parallel (DDP) accelerator , the NVIDIA Collective Communication Library (NCCL), PyTorch Lightning and LitMatter for multi-GPU, multi-node training.