class_docstr: Inverse square root LR scheduler.
  
  Args:
      optimizer (Optimizer): Torch optimizer.
      warmup_steps (int): Number of warmup steps.
      warmup_init_lr (tp.Optional[float]): Initial learning rate
          during warmup phase. When not set, use the provided learning rate.
code: def __init__(
      self,
      optimizer: Optimizer,
      warmup_steps: int,
      warmup_init_lr: tp.Optional[float] = 0,
  ):
      self.warmup_steps = warmup_steps
      self.warmup_init_lr = warmup_init_lr
      super().__init__(optimizer)
  
file_path: audiocraft/audiocraft/optim/inverse_sqrt_lr_scheduler.py
imports: import typing
  from torch.optim import Optimizer
  from torch.optim.lr_scheduler import _LRScheduler
label_desc: Use image node_id 1 to create a new InverseSquareRootLRScheduler object from inherited base classes: _LRScheduler with example: obj = InverseSquareRootLRScheduler(optimizer, warmup_steps, warmup_init_lr)