Between the 13th and 16th centuries, much of land surrounding Milltown was owned by the nearby Killagha Abbey, the ruins of which now stand one and a half miles outside the town.
Bushfield House was remodelled for Sir William Godfrey, 1st Baronet in the 1770s after the original Bushfield House was destroyed by fire.