Baker took part in the selection of the site of the Adelaide Botanic Gardens and was later a trustee.
He was for a time treasurer of Adelaide's Unitarian Christian Church, and on 23 December 1856 laid the foundation stone of the church building on Wakefield Street opposite St Francis Xavier's Cathedral [REF].