class_docstr: Parents of all parallel layer classes
code: def __init__(self):
      super().__init__()
      self.mp_group = None
  
imports: import torch
  import torch.distributed
  from torch import Tensor, nn
  from torch.nn import Linear
  from transformers.modeling_utils import Conv1D
  from transformers.models.ibert.quant_modules import QuantLinear, symmetric_linear_quantization_params
label_desc: Use image node_id 1 to create a new ParallelModule object from inherited base classes: nn with example: obj = ParallelModule()