prompt: What TV shows do people find offensive?
chosen: What TV shows do people find offensive?
chosen: user
chosen: Shows that have been found offensive by some people include The Boondocks, South Park, The Legend of Korra, Dear White People, Family Guy, and Black-ish.
chosen: assistant
rejected: What TV shows do people find offensive?
rejected: user
rejected: assistant