Trained a regression network and getting EXACT same result on validation set, on every epoch
The answer is I was too tired to see I was using the same model for validation every epoch, instead of that epoch's model.

Write good code, and this won't happen to you.