class_docstr: A synchronized cuda memory monitor.
  It only record the maximum allocated cuda memory from start point to finish point.
class_docstr_tok: ["A","synchronized","cuda","memory","monitor",".","It","only","record","the","maximum","allocated","cuda","memory","from","start","point","to","finish","point","."]
code: def __init__(self, power: int = 10):
      super().__init__()
  
imports: import json
  from abc import abstractmethod
  from concurrent.futures import ThreadPoolExecutor
  from time import sleep, time
  import torch
  from colossalai.utils import get_current_device
label_desc: Use image node_id 1 to create a new SyncCudaMemoryMonitor object from inherited base classes: MemoryMonitor with example: obj = SyncCudaMemoryMonitor(power)