class_docstr: AllGather op with gradient backward
class_docstr_tok: ["AllGather","op","with","gradient","backward"]
code: def forward(ctx, tensor, *gather_list):
      gather_list = list(gather_list)
      distributed.all_gather(gather_list, tensor)
      return tuple(gather_list)
  
imports: import math
  from typing import Callable
  import torch
  from torch import distributed
  from torch.nn.functional import linear, normalize
label_desc: Use image node_id 1 for calling the AllGatherFunc obj's underlying member method code with example usage: obj.forward(ctx, tensor) and returns: tuple