Statistical significance test in deep learning for regression problems
You could use either the k-fold or the test-only.

The k-fold is a possibility which gives you more robustness because you tried on every possible combination of train/test, but you are still avoiding overfitting if you use the train/test partition.

Just make sure you use the same dataset in all the comparisons you make.