 In 1857 he gained control, but several years later, when Sargent attempted to purchase property needed for expansion, he was met with opposition.Exasperated, he moved the entire operation to New Haven which had the advantage of being on a harbor with a train line.He purchased with his brothers, George and Edward, property at Water, Wallace and Hamilton Streets.