Wait until all the foliage of the plant has withered and died back before harvesting mature potatoes. After the foliage has died, dig up a potato from one or two plants and rub the skin of the potato with your fingers. The skin of a potato that is ready for harvest won't scrub off easily.