Following his graduation in 1882, Bliss was ordained a Congregationalist minister.
During the 1880s, Bliss became interested in the writings of Charles Kingsley and Frederick Denison Maurice, which led him to Christian Socialism, a movement which sought to apply the teachings of Christ to modern social difficulties, caused, they believed, by industrialization and urbanization.