code: def __init__(self, num_expert, world_size):
      super().__init__()
      self.world_size = world_size
      self.num_expert = num_expert
      self.tot_expert = world_size * num_expert
      self.loss = None
  
file_path: fastmoe/fmoe/gates/base_gate.py
imports: import torch.nn
label_desc: Use image node_id 1 to create a new BaseGate object from inherited base classes: nn with example: obj = BaseGate(num_expert, world_size)