How to react to a student proselytising during office hours?
You address this by stating directly 


  "I would prefer not to discuss this topic during office hours. Can I help you with any questions you have on the homework?"


If the issue persists, I would speak with the professor and perhaps also your dean of students (or something similar).