Williams is the son of Clayton W. Williams, Sr., a Pecos county commissioner, and the former Chicora Lee "Chic" Graham [REF].
He graduated from Texas A&M University in College Station in 1954 with a degree in animal husbandry.