 Dudley was born in Aurora, North Carolina, the fifth of 11 children.When he was in the first grade, he was mistakenly labeled as being mentally retarded because of a speech impediment.He was twice held back by the time he reached the eleventh grade.