Frazar was educated at the then Southwestern Institute in Lafayette having received a Bachelor of Arts degree in history in 1928.
On August 22, 1929, Frazar married the former Lily Hooper (December 12, 1904 - November 5, 1994), who was living in Baton Rouge at the time of her death.