Smith traveled to the Chocolate Mountains (and possibly the Santa Rosa Mountains, or the Borrego Badlands) where, after several years of prospecting, he was forced, by local tribes, to escape the area. Claiming he had discovered a large amount of gold-bearing quartz, Smith sold maps and claims to other prospectors of a mine known as the Lost Pegleg Mine until his death in a San Francisco hospital in 1866.