A coin left on a headstone or at the grave site is meant as a message to the deceased soldier's family that someone else has visited the grave to pay respect. Leaving a penny at the grave means simply that you visited. ... There are quite a few superstitions that compel people to leave money on a loved ones grave.