

backward_prefetch (Optional[BackwardPrefetch]) --
        This configures explicit backward prefetching of all-gathers.
        See "BackwardPrefetch" for details. (Default: "BACKWARD_PRE")


mixed_precision (Optional[MixedPrecision]) -- This
    configures native mixed precision for FSDP. If this is set to
    "None", then no mixed precision is used. Otherwise, parameter,
    buffer, and gradient reduction dtypes can be set. See
    "MixedPrecision" for details. (Default: "None")


ignored_modules
    (Optional[Iterable[torch.nn.Module]]) -- Modules
    whose own parameters and child modules' parameters and buffers
    are ignored by this instance. None of the modules directly in
    "ignored_modules" should be "FullyShardedDataParallel"
    instances, and any child modules that are already-constructed
    "FullyShardedDataParallel" instances will not be ignored if



