title: PyTorch - How to get learning rate during training?
body: <p>While training, I'd like to know the value of learning_rate.
  What should I do?</p>
  
  <p>It's my code, like this:</p>
  
  <pre><code>my_optimizer = torch.optim.SGD(my_model.parameters(), 
                                 lr=0.001, 
                                 momentum=0.99, 
                                 weight_decay=2e-3)
  </code></pre>
  
  <p>Thank you.</p>