 At the age of 17, Spencer stowed away to Australia on the "Trusty", arriving in Bunbury in December 1842.On arrival, he was employed as a shepherd, but initially had his wages docked to pay off his passage.Spencer later worked as a police constable, a court clerk, and a tidewaiter (customs officer).