Glover was born in Macon County, North Carolina, the son of Charles Glover and Caroline Piercy Glover.
He was also involved in several other business ventures, including as Director of the Washington and Georgetown Railroad, the ancestor of the Washington Metro, and as President of the Washington Stock Exchange.