 Williams' paternal ancestors were a mix of Welsh, English, and Irish.The maternal, Mexican side of Williams' family was quite diverse, having Spanish (Basque), Russian, and American Indian roots.Of his Mexican ancestry he said that "If I had my mother's name, there is no doubt I would have run into problems in those days, [considering] the prejudices people had in Southern California".