How to push object straight in game engine
Your collision bounds on both objects are a sphere. Under the Physic tab check the button for "Collision Bounds". Now assuming you two objects are cubes, the cube collision bounds will work fine.