in-SNR weighting strategy might not appear to be pronounced, but for larger datasets, we believe the effects will be more pronounced.
Also, note that in this example, we either predict epsilon (i.e., the noise) or the v_prediction. For both of these cases, the formulation of the Min-SNR weighting strategy that we have used holds. 
Training with Min-SNR weighting strategy is only supported in PyTorch.

LoRA
	
You can also use Low-Rank Adaptation