etrained weights are kept frozen so that the model is not so prone to catastrophic forgetting. 
Rank-decomposition matrices have significantly fewer parameters than the original model, which means that trained LoRA weights are easily portable.
LoRA matrices are generally added to the attention layers of the original model and they control to which extent the model is adapted toward new training images via a scale parameter.
Note that the usage 