He was born at St Bathens, near Dunbar, the son of the Minister of Yester Parish Church, James Fleming, whose first wife (not Robert's mother) had been Martha Knox, eldest daughter of John Knox.
While in the Netherlands, Fleming was accused, but cleared, of plotting with the enemies of the King (by that time, the Roman Catholic King James II and VII).