Chirality of heteroatoms
Typical amines ($\ce{NR3}$) are roughly $\ce{sp^3}$ hybridized.  A chiral amine must undergo nitrogen inversion in order to racemize. The transition state for nitrogen inversion is a planar $\ce{sp^2}$ structure.  So in order to invert the ligands attached to nitrogen we must move from an $\ce{sp^3}$ ground state with ca. 109 degree bond angles to an $\ce{sp^2}$ transition state with 120 degree bond angles.

On the other hand typical $\ce{PR3}$ compounds are roughly unhybridized with 90 degree bond angles in the ground state.  In order to racemize they must also invert at phosphorous which again requires an $\ce{sp^2}$ transition state with 120 degree bond angles.  Changing the geometry from 90 to 120 degrees in the case of phosphorous requires more energy that a distortion from 109 to 120 degrees in the case of nitrogen.

P.S. Put a chiral nitrogen in a 3-membered ring and chirality can be preserved because you've now made it so much more difficult to expand the 60 degree bond angle in the ring to 120 degrees.