temporal Batch Normalization.
Currently "SyncBatchNorm" only supports "DistributedDataParallel"
   (DDP) with single GPU per process. Use
   "torch.nn.SyncBatchNorm.convert_sync_batchnorm()" to convert
   "BatchNorm*D" layer to "SyncBatchNorm" before wrapping Network with
   DDP.
Parameters:
      * num_features (int) -- C from an expected input of size
        (N, C, +)
  * **eps** (*float*) -- a value added to the denominator for
    numerical stability. Default: "1e-5"

  * **momentum** (*float*) -- the value used for the running_mean
    and running_var computation. Can be set to "None" for
    cumulative moving average (i.e. simple average). Default: 0.1

  * **affine** (*bool*) -- a boolean value that when set to
    "True", this module has learnable affine parameters. Default:
    "True"

  * **track_running_stats** (*bool*) -- a boolean value that when
    set to "True", this module tracks the running mean and
