In 1816, the family moved to France, and lived in St Germain as well as Paris, but in 1818, after the aforementioned death of his maternal grandfather, the family had to return to England.
Needing no employment, FitzGerald moved to his native Suffolk where he lived quietly, never leaving the county for more than a week or two while he resided there.