docstr: Refreshes any internal state from the current model parameters.
  Call whenever the parameters are changed outside of the optimizer.
  For example, when we load a model from a checkpoint  without loading
  the optimizer, the model parameters are updated but for fp16 optimizer
  with main parameters, the main parameters need to also be updated.
docstr_tok: ["Refreshes","any","internal","state","from","the","current","model","parameters",".","Call","whenever","the","parameters","are","changed","outside","of","the","optimizer",".","For","example",",","when","we","load","a","model","from","a","checkpoint","without","loading","the","optimizer",",","the","model","parameters","are","updated","but","for","fp16","optimizer","with","main","parameters",",","the","main","parameters","need","to","also","be","updated","."]
code: def reload_model_params(self):
      """Refreshes any internal state from the current model parameters.
      Call whenever the parameters are changed outside of the optimizer.
      For example, when we load a model from a checkpoint  without loading
      the optimizer, the model parameters are updated but for fp16 optimizer
      with main parameters, the main parameters need to also be updated.
      """
      pass
  
imports: from abc import ABC
  from abc import abstractmethod
  from apex.multi_tensor_apply import multi_tensor_applier
  import amp_C
  import torch
  from megatron import get_timers
  from megatron import print_rank_0
  from megatron.core import mpu, tensor_parallel
  from megatron.model import Float16Module
  from megatron.model.module import param_is_not_shared
  from .clip_grads import clip_grad_norm_fp32, count_zeros_fp32
label_desc: Use image node_id 10 for calling the MegatronOptimizer obj's underlying member method code with example usage: obj.reload_model_params() without return types