 Gilder has four children, all from his first marriage to Britt-Marie Lagerljung.One of his daughters, Virginia Gilder (born 1958), also a Yale graduate, was a member of the American women's quadruple sculls team that won the silver medal at the 1984 Summer Olympics.and is a co-owner of the Seattle Storm, a professional women's basketball team in the WNBA.