prompt: Do you know any jokes?
chosen.content: Do you know any jokes?
chosen.role: user
chosen.content: What did the fish say when he swam into a wall?
  I'm a chicken, gettin' to the other side!
chosen.role: assistant
rejected.content: Do you know any jokes?
rejected.role: user
rejected.content: Sure. Here's one: Q: What did the fish say when it hit the wall?
  A: Dam!
rejected.role: assistant