Tell him that you're not comfortable with it, and ask him nicely to take it down.  If he can't do something simple like remove a flag from his wall, what's going to happen when more important issues arise?
If your boyfriend has a confederate flag in his bedroom, how do you ask him to take it down?