class_docstr: A fake mlp without model parallelism for correctness testing
class_docstr_tok: ["A","fake","mlp","without","model","parallelism","for","correctness","testing"]
code: def __init__(self, args, _):
      super().__init__()
      self.fc1 = nn.Linear(args.hidden_size, args.hidden_hidden_size)
      self.fc2 = nn.Linear(args.hidden_hidden_size, args.hidden_size)
  
file_path: smart-moe/fmoe/megatron/layers.py
imports: import math
  import numpy
  import torch
  import torch.nn
  import torch.nn.functional
  from fmoe.transformer import FMoETransformerMLP
  from .balance import reset_gate_hook
  from .balance import generate_megatron_gate_hook
label_desc: Use image node_id 1 to create a new _FakeMegatronMLP object from inherited base classes: nn with example: obj = _FakeMegatronMLP(args, _)