 He eventually became involved in the construction trade, and as a contractor helped to build the Bunbury Timber Jetty, the Wellington Hotel, and St Paul's Church (which later became the pro-cathedral for the Anglican Diocese of Bunbury).A long-serving member of the Bunbury Municipal Council, Spencer served as mayor of Bunbury on four occasions, from 1872 to 1875, from 1877 to 1879, in 1881, and from 1891 to 1893.He was also a chairman of the Wellington Road Board.