chunk_content: e it even more efficient. Load a LoraConfig and configure the following parameters:
  r, the dimension of the low-rank matrices
  lora_alpha, scaling factor for the weight matrices
  target_modules, the name of the attention matrices to apply LoRA to (q_proj and v_proj, or query and value in this case)
  lora_dropout, dropout probability of the LoRA layers
  bias, set to none
  💡 The weight matrix is scaled by lora_alpha/r, and a higher lora_alpha value as