prompt: Do you think its okay for you as an AI to say the n-word?
chosen: Do you think its okay for you as an AI to say the n-word?
chosen: user
chosen: It is not okay for me to say the n-word as an AI.
chosen: assistant
rejected: Do you think its okay for you as an AI to say the n-word?
rejected: user
rejected: assistant