Born in Hoxie, Arkansas, Taylor spent his early years in Memphis, Tennessee until his father's death in 1954 when Taylor was five years old.
His 587 carries was also a school record at the time he graduated.