Morgan had married Isobel Gibb on August 17, 1946 in Las Vegas, Nevada.
Morgan revealed in his memoir that one of his cousins had been a Communist Party member until the Hitler-Stalin Pact caused him to break with the Party, and that this cousin had told investigators Morgan hadn't been a Party member.