chunk_content: for Lora scaling.
  
  
  lora_dropout (float) — The dropout probability for Lora layers.
  
  
  fan_in_fan_out (bool) — Set this to True if the layer to replace stores weight like (fan_in, fan_out).
  
  
  For example, gpt-2 uses Conv1D which stores weights like (fan_in, fan_out) and hence this should be set to True. —
  
  
  bias (str) — Bias type for Lora. Can be ‘none’, ‘all’ or ‘lora_only’. If ‘all’ or ‘lora_only’, the
  corresponding biases will be updated duri