Penn, fluent in French, Greek, Latin and Hebrew, was a Fellow of the Society of Antiquaries and wrote several books dealing with Biblical criticism and published a number of competent translations of ancient Greek works, including a critical revision of the English version of the New Testament.
His major work as a scriptural geologist was A Comparative Estimate of the Mineral and Mosaical Geologies, published in 1822.