Adamax
class torch.optim.Adamax(params, lr=0.002, betas=(0.9, 0.999), eps=1e-08, weight_decay=0, foreach=None, *, maximize=False, differentiable=False)
Implements Adamax algorithm (a variant of Adam based on infinity
   norm).
  \begin{aligned}      &\rule{110mm}{0.4pt}
  \\      &\textbf{input}      : \gamma \text{ (lr)}, \beta_1,
  \beta_2          \text{ (betas)},\theta_0 \text{
  (params)},f(\theta) \text{ (objective)},          \: \lambda
  \text{ (weight decay)},
  \\      &\hspace{13mm}    \epsilon \text{ (epsilon)}
  \\      &\textbf{initialize} :  m_0 \leftarrow 0 \text{ ( first
  moment)},          u_0 \leftarrow 0 \text{ ( infinity norm)}
  \\[-1.ex]      &\rule{110mm}{0.4pt}
  \\      &\textbf{for} \: t=1 \: \textbf{to} \: \ldots \:
  \textbf{do}                         \\      &\hspace{5mm}g_t
  \leftarrow   \nabla_{\theta} f_t (\theta_{t-1})           \\
  &\hspace{5mm}if \: \lambda \neq 0
