Collision groups and mask?
For the controller, check the Ghost option under the physics tab. This will cause the object to still fall, but there won't be any collisions. You can also parent the character to the controller without having do a major freak-out.