class_docstr: Wrapper for a Linear class that returns its own bias parameter, such as
  used by Megatron-LM.
class_docstr_tok: ["Wrapper","for","a","Linear","class","that","returns","its","own","bias","parameter",",","such","as","used","by","Megatron-LM","."]
docstr: Reduces output tensors, but not the returned bias. 
docstr_tok: ["Reduces","output","tensors",",","but","not","the","returned","bias","."]
code: def _reduce_local_output(self, in_id, out_id, current_out, new_out):
      """Reduces output tensors, but not the returned bias."""
      if current_out is not None:
          old_tensor, old_bias = current_out
      else:
          old_tensor, old_bias = None, None
  
      assert isinstance(new_out, tuple)
      assert len(new_out) == 2
  
      tensor, bias = new_out
      assert tensor is not None
  
      tensor = super()._reduce_local_output(
          in_id=in_id,
          out_id=out_id,
          current_out=old_tensor,
          new_out=tensor,
      )
  
      if bias is None:
          bias = old_bias
  
      return tensor, bias
  
file_path: DeepSpeed/deepspeed/runtime/zero/tiling.py
imports: import torch
  import deepspeed
  from deepspeed.runtime.utils import partition_uniform
label_desc: Use image node_id 1 for calling the TiledLinearReturnBias obj's underlying member method code with example usage: obj._reduce_local_output(in_id, out_id, current_out, new_out) and returns: tensor,  bias