torch.cuda.comm.scatter
torch.cuda.comm.scatter(tensor, devices=None, chunk_sizes=None, dim=0, streams=None, *, out=None)
Scatters tensor across multiple GPUs.
Parameters:
      * tensor (Tensor) -- tensor to scatter. Can be on CPU or
        GPU.
  * **devices** (*Iterable**[**torch.device**, **str** or
    **int**]**, **optional*) -- an iterable of GPU devices, among
    which to scatter.

  * **chunk_sizes** (*Iterable**[**int**]**, **optional*) -- sizes
    of chunks to be placed on each device. It should match
    "devices" in length and sums to "tensor.size(dim)". If not
    specified, "tensor" will be divided into equal chunks.

  * **dim** (*int**, **optional*) -- A dimension along which to
    chunk "tensor". Default: "0".

  * **streams** (*Iterable**[**Stream**]**, **optional*) -- an
    iterable of Streams, among which to execute the scatter. If
    not specified, the default stream will be utilized.
