Lucie was the only child of John Austin (1790-1859), a jurist, and his wife Sarah Austin, a translator.
On 16 May 1840 she married in Kensington Old Church Sir Sir Alexander Cornewall Duff-Gordon, 3rd Baronet, of Halkin.