In 1886, while managing editor of the Grafton (Nebraska) Leader, Parrish was persuaded to enter the Congregational ministry, being licensed by the Elkhorn Association and given charge of churches at Leigh and Howells, Nebraska.
In 1887 Parrish was married to Miss Mary A. Hammon, of Clarkson, Nebraska, and four children were born unto this union, two of whom survived to adulthood, namely: Robert Arthur, a cadet at St. John's Military Academy, Delafield, Wisconsin; and Philip Hammon, of Lynch, Nebraska.