class_docstr: Keras Callback that will broadcast all global variables from root rank
  to all other processes during initialization.
  This is necessary to ensure consistent initialization of all workers when
  training is started with random weights or restored from a checkpoint.
class_docstr_tok: ["Keras","Callback","that","will","broadcast","all","global","variables","from","root","rank","to","all","other","processes","during","initialization",".","This","is","necessary","to","ensure","consistent","initialization","of","all","workers","when","training","is","started","with","random","weights","or","restored","from","a","checkpoint","."]
docstr: Construct a new BroadcastGlobalVariablesCallback that will broadcast all
  global variables from root rank to all other processes during initialization.
  Args:
      root_rank: Rank that will send data, other ranks will receive data.
      device: Device to be used for broadcasting. Uses GPU by default.
docstr_tok: ["Construct","a","new","BroadcastGlobalVariablesCallback","that","will","broadcast","all","global","variables","from","root","rank","to","all","other","processes","during","initialization",".","Args",":","root_rank",":","Rank","that","will","send","data",",","other","ranks","will","receive","data",".","device",":","Device","to","be","used","for","broadcasting",".","Uses","GPU","by","default","."]
code: def __init__(self, root_rank, device=""):
      """
      Construct a new BroadcastGlobalVariablesCallback that will broadcast all
      global variables from root rank to all other processes during initialization.
      Args:
          root_rank: Rank that will send data, other ranks will receive data.
          device: Device to be used for broadcasting. Uses GPU by default.
      """
      super(BroadcastGlobalVariablesCallback, self).__init__(
          K, root_rank, device
      )
  
file_path: byteps/byteps/keras/callbacks.py
imports: import keras
  import keras.backend
  from byteps._keras import callbacks
label_desc: Use image node_id 1 to create a new BroadcastGlobalVariablesCallback object from inherited base classes: _impl, keras.callbacks with example: obj = BroadcastGlobalVariablesCallback(root_rank, device)