Colver, a third-generation Southern Californian was born on June 17, 1949, in Pomona, California, was named after his great-grandfather, who arrived in the United States from Cornwall, England, in 1635. Edward's father, Charles Colver, was a forest ranger for 43 years. Upon his retirement, Charles was presented with the Theodore Roosevelt Conservation Award by President George H. W. Bush at the White House. The tallest peak southwest of Mount San Antonio aka Mount Baldy, was named Colver Peak after Charles.