TensorFlow 2.0 - Normalizing input to DNN (on structured data)
One way could be to first iterate over the dataset in batches, just to get the mean and sd. Then when running training, use the true population parameters obtained before.