In the period from 1788 Penn played a part in the development of veterinary education.
In 1834 Penn succeeded his brother, John Penn, in the estates of Stoke Park, Buckinghamshire, and Pennsylvania Castle, Portland.