Where M , is the number of cycles, R is the proportion used to increase β within a cycle, T is the total number of training steps, t is the current step in training and f is a monotonically increasing function. For our training we used R = 0.7, M = 20. These parameters were selected by hyperparameter tuning using the reconstruction and validity of the trained models as criteria (as defined in section 4).