 Williams was born in Atlanta, Georgia, but grew up in Los Angeles, California.He received an Artium Baccalaureus degree from the University of California, Los Angeles in 1934 and a Bachelor of Laws from the USC Gould School of Law in 1937, and was admitted to the California bar in 1937.He was in private practice in Los Angeles from 1937 to 1955.