Ryder was born in Oberlin, Ohio in 1871, but moved with his family as a youth to New England.
Before the Oberlin team would play a game, however, Ryder decided to transfer to Williams College in Williamstown, Massachusetts.