🤔How to align stronger LLMs with weaker LLMs without collapse?
Thrilled to share that our paper, "MACPO: Weak-to-Strong Alignment via Multi-Agent Contrastive Preference Optimization" has been accepted at #ICLR2025, co-authored with @lingyongyan, @ZihanWa54274484, @yindawei, @jayren3, @mdr, and @zhaochun_ren

Pape is here: