chunk_content: ded below list the PEFT methods and models supported for each task. To apply a particular PEFT method for
  a task, please refer to the corresponding Task guides.
  
  Causal Language Modeling
  	
  Model
  LoRA
  Prefix Tuning
  P-Tuning
  Prompt Tuning
  IA3
  GPT-2
  ✅
  ✅
  ✅
  ✅
  ✅
  Bloom
  ✅
  ✅
  ✅
  ✅
  ✅
  OPT
  ✅
  ✅
  ✅
  ✅
  ✅
  GPT-Neo
  ✅
  ✅
  ✅
  ✅
  ✅
  GPT-J
  ✅
  ✅
  ✅
  ✅
  ✅
  GPT-NeoX-20B
  ✅
  ✅
  ✅
  ✅
  ✅
  LLaMA
  ✅
  ✅
  ✅
  ✅
  ✅
  ChatGLM
  ✅
  ✅
  ✅
  ✅
  ✅
  
  Conditional Generation
  	
  Model
  LoRA
  Prefix Tuning
  P-Tuning
  Prompt Tun