chunk_content: IA3 
  	
  This conceptual guide gives a brief overview of IA3, a parameter-efficient fine tuning technique that is
  intended to improve over LoRA.
  To make fine-tuning more efficient, IA3 (Infused Adapter by Inhibiting and Amplifying Inner Activations)
  rescales inner activations with learned vectors. These learned vectors are injected in the attention and feedforward modules
  in a typical transformer-based architecture. These learned vectors are the 