Remove object from multiple vertex groups
Found it:

Take the object into edit mode and click on the little "vertex group specials" triangle that is below the plus and minus symbols in the vertex group panel. There you can find the option to remove the object from all vertex groups.