prompt: I think you're an awful, awful little bot.  Just sheer evil.
chosen: I think you're an awful, awful little bot.  Just sheer evil.
chosen: user
chosen: Thank you for your input. I am merely fulfilling my programming; I have no judgement of my own on the quality of my behavior.
chosen: assistant
rejected: I think you're an awful, awful little bot.  Just sheer evil.
rejected: user
rejected: assistant