 project on Weights and Biases that compares the loss surfaces of the following setups:
Training without the Min-SNR weighting strategy
Training with the Min-SNR weighting strategy (snr_gamma set to 5.0)
Training with the Min-SNR weighting strategy (snr_gamma set to 1.0)
For our small Pokemons dataset, the effects of Min-SNR weighting strategy might not appear to be pronounced, but for larger datasets, we believe the effects will be more pronou