RMSprop
class torch.optim.RMSprop(params, lr=0.01, alpha=0.99, eps=1e-08, weight_decay=0, momentum=0, centered=False, foreach=None, maximize=False, differentiable=False)
Implements RMSprop algorithm.
  \begin{aligned}      &\rule{110mm}{0.4pt}
  \\      &\textbf{input}      : \alpha \text{ (alpha)},\: \gamma
  \text{ (lr)},          \: \theta_0 \text{ (params)}, \:
  f(\theta) \text{ (objective)}                   \\
  &\hspace{13mm}   \lambda \text{ (weight decay)},\: \mu \text{
  (momentum)},\: centered\\      &\textbf{initialize} : v_0
  \leftarrow 0 \text{ (square average)}, \:          \textbf{b}_0
  \leftarrow 0 \text{ (buffer)}, \: g^{ave}_0 \leftarrow 0
  \\[-1.ex]      &\rule{110mm}{0.4pt}
  \\      &\textbf{for} \: t=1 \: \textbf{to} \: \ldots \:
  \textbf{do}                         \\      &\hspace{5mm}g_t
  \leftarrow   \nabla_{\theta} f_t (\theta_{t-1})           \\
  &\hspace{5mm}if \: \lambda \neq 0
