Born in Ogden, Utah, Borglum was the younger brother of Gutzon Borglum and uncle of Lincoln Borglum, the two men most responsible for the creation of the carvings at Mount Rushmore.
Solon's father was a physician but had worked as a wood-carver, which almost certainly influenced Solon's older brother, Gutzon, to pursue a career as an artist.