Parrish was born in the city of Kewanee, the only son of Rufus Parker and Frances Adeline (Hollis) Parrish.
His health breaking down from close confinement, he crossed the plains in 1882 with a cattle party, walking most of the way to Las Vegas, New Mexico.