Sloan was born in Bunker Hill, Indiana, near Kokomo, the son of a Union Army soldier.
By 1886, Sloan was working at Latonia Race Track in Covington, Kentucky, where trainer Sam Hildreth gave him the opportunity to ride one of his horses.