Invisible Physics to Certain Objects in the BGE
You can do this with collision mask and collision group.



These options are found in the physics panel. To fix your particular problem, select the invisible collision box for the player and put it in collision group 2. 

Next, select the bullet and while holding Shift click on the 2nd box in collision mask. This will stop the bullet from colliding with anything in collision group/layer 2.