


    train_batch(...)
    scheduler.step()




get_last_lr()
  Return last computed learning rate by current scheduler.

get_lr()
  Calculates the learning rate at batch index. This function
  treats *self.last_epoch* as the last batch index.

  If *self.cycle_momentum* is "True", this function has a side
  effect of updating the optimizer's momentum.

print_lr(is_verbose, group, lr, epoch=None)
  Display the current learning rate.
