In 1654 William Coton and John Stubbs, while on a visit to Lydd, stayed at Fisher's house, and convinced him of the truth of quakerism.
In May 1659 he went to Dunkirk with Edward Burrough; when the authorities ordered them to leave the town, they declined, and were then directed to be moderate.