chunk_content: configuration file, it uses the TRANSFORMER_BASED_WRAP option to wrap the T5Block layer.
  
  
  	Copied
  if getattr(accelerator.state, "fsdp_plugin", None) is not None:
      accelerator.state.fsdp_plugin.auto_wrap_policy = fsdp_auto_wrap_policy(model)
  Next, use 🤗 Accelerate’s prepare function to prepare the model, datasets, optimizer, and scheduler for training.
  
  
  	Copied
  model, train_dataloader, eval_dataloader, optimizer, lr_scheduler = accelerator.