Born in Oakland, California on June 27, 1871, Smalley was just 17 when he joined his hometown team, the California League's Oakland Greenhood and Morans in 1888.
In 1891, Smalley hooked on with Washington of the American Association.