Hillyer was born and raised in New Orleans, Louisiana and graduated from the Isidore Newman School in 1982 before matriculating at Georgetown University in Washington, D.C., graduating with an A.B. in government and theology (cum laude) in 1986.
Following the 1988 elections, former Louisiana Democrat David Duke switched parties in an attempt to reach higher office.