 As many Quakers did during the Revolution, he maintained a neutral position with respect to the fledgling country's conflicts, and he and his family suffered as a consequence.In 1777 Fisher's sons were ordered by the authorities to produce their firm's business records but they refused, and since they were Quakers they refused to swear an oath of allegiance.As a consequence sons Thomas, Samuel, Meirs were exiled to Winchester, Virginia along with several other Quakers, and kept under house arrest for a year.