Flavel was four times married: first to Jane Randal; secondly, to Elizabeth Morries; thirdly, to Ann Downe; and, lastly, to a daughter of the Rev. George Jeffries.
There is a portrait of him in Dr Williams's Library, London.