chunk_content: opied
  from peft import LoraConfig
  
  config = LoraConfig(
      target_modules=["seq.0", "seq.2"],
      modules_to_save=["seq.4"],
  )
  With that, we can create our PEFT model and check the fraction of parameters trained:
  
  
  	Copied
  from peft import get_peft_model
  
  model = MLP()
  peft_model = get_peft_model(module, config)
  peft_model.print_trainable_parameters()
  # prints trainable params: 56,164 || all params: 4,100,164 || trainable%: 1.369798866581922
  F