Sherar was born in Vermont in 1833 after his parents had immigrated there from Ireland with their first three children.
In 1855, Sherar left New York and traveled to California, where he tried mining, hauling goods by pack animal, and then farming along the Klamath River before moving to Oregon in 1862.