where 𝛼 3 is the step size, 𝛽 ! , 𝛽 7 is the decay rate to calculate the moving average and moving 2 nd moment, 𝑓 3 (𝜃) is the stochastic objective function. 𝜃 3 is the resulting parameter, and 𝑝 H = 2/(1 -𝛽 7 ) -1 is the maximum length of the approximated simple moving average.