Detecting Offensive Text Content in English and German
Toxic comment classification challenge might be a good place to start.  It contains a set of comments and 6 binary classifications indicting if it's a toxic comment and of which type.

I imagine this would be a sufficient start.