How can I remove a prop that is used in an action but not needed in another?
Found something even better! Mentalist gave me much better search terms and I've now found the best answer to the solution. I didn't even know the eye (visibility) icon in the Outliner could be keyframed before =P 

Thanks all for the help!

Animate the Viewport Visibility of an Object within the Timeline?