In 1832, Polk moved his family to the vast Polk Rattle and Snap tract in Maury County, Tennessee, and constructed a massive Greek Revival home called Ashwood Hall.
Bishop Polk was the leading founder of the University of the South in Sewanee, Tennessee, which he envisioned as a national university for the South and a New World equivalent to Oxford and Cambridge, both in England.