class_docstr: Group of timers. Borrowed from Nvidia Megatron code
code: def __init__(self):
      self.timers = {}
  
imports: import time
  from numpy import mean
  from deepspeed.utils.logging import log_dist
  from deepspeed.accelerator import get_accelerator
label_desc: Use image node_id 1 to create a new SynchronizedWallClockTimer object  with example: obj = SynchronizedWallClockTimer()