earning, which is implemented in 🤗 TRL with the ~trl.DDPOTrainer. For more information, check out the ~trl.DDPOTrainer API reference and the Finetune Stable Diffusion Models with DDPO via TRL blog post.
