 His second wife was Florence Von Karajan.From Georgia, Sargent moved his family to Brooklyn where he began work in the hardware field.He was successful, eventually becoming a major stockholder in Peck & Walter Hardware of New Britain.