 He developed a robust transatlantic trade in animal pelts and became wealthy, moving his family to downtown Philadelphia in 1746, and building the Cliffs as a country getaway.He brought his family to the Cliffs house and farm in the summer and they grew up interested in nature, with an appreciation of the Quaker testimony of simplicity.Fisher's son Samuel Rowland Fisher, his wife Hannah Rodman Fisher, and their three children, Sarah, Deborah, and Thomas, spent their summers in the house during the years 1793–1834.