Why are parameter updates downscaled by uncentered variance (instead of centered variance) in Adam optimizer?
If anything, you don't have access to the mean. When we talk about the variance, we talk about the variance of a distribution. The distribution in this case is the total collection of gradients at each step of the optimization process, which you don't know until you're done.