When he was seventeen, Walton was appointed Deputy District Clerk and in about two years saved enough money to go to the University of Virginia, where he studied law.
While in Carrollton, Walton met and grew to love seventeen-year-old Lettie Watkins, whose parents, Dr. Thomas A. Watkins and Sarah Epes Fitzgerald Watkins, had a plantation nearby.