In his private life, Serviss was an enthusiastic mountain climber. He described his reaching the summit of the Matterhorn at the age of 43 as part of an effort to get as far away from terrestrial gravity as possible. His son was the Olympic high jumper Garrett Serviss.