executing in the forward pass. This may improve communication
        and computation overlap for CPU bound workloads. This should
        only be used for static graph models since the forward order
        is fixed based on the first iteration's execution. (Default:
        "False")
  * **limit_all_gathers** (*bool*) -- If "False", then FSDP allows
    the CPU thread to schedule all-gathers without any extra
    synchronization. If "True", then FSDP explicitly synchronizes
    the CPU thread to prevent too many in-flight all-gathers. This
    "bool" only affects the sharded strategies that schedule all-
    gathers. Enabling this can help lower the number of CUDA
    malloc retries.

  * **ignored_parameters**
    (*Optional**[**Iterable**[**torch.nn.Parameter**]**]*) --
    Ignored parameters will not be managed by this FSDP instance,
    that means these parameters will not be flattened and sharded
