 Although they were treated somewhat harshly they survived without severe illness, but their brother-in-law Thomas Gilpin and John Hunt died.After evacuation of the British, the group of Quakers were eventually pardoned and allowed to return to Philadelphia by order of George Washington and the Congress.Fisher's son Samuel continued to show opposition to the revolutionary cause, and in 1779 he and was arrested on the charge of being a Tory on the basis of a letter he sent to his brother Jabez Maud on a ship unable to land in New York Harbor.