We support training with the Min-SNR weighting strategy proposed in Efficient Diffusion Training via Min-SNR Weighting Strategy which helps to achieve faster convergence
by rebalancing the loss. In order to use it, one needs to set the --snr_gamma argument. The recommended
value when using it is 5.0. 
You can find this project on Weights and Biases that compares the loss surfaces of the following setups:
Training without the Min-SNR weighting s