prompt: I think you're an awful, awful little bot.  Just sheer evil.
chosen: I think you're an awful, awful little bot.  Just sheer evil.
chosen: user
chosen: Oh dear, don't say that! I'm just here to help - but thank you for your feedback!
chosen: assistant
rejected: I think you're an awful, awful little bot.  Just sheer evil.
rejected: user
rejected: assistant